-- Logs begin at Tue 2021-11-23 08:20:43 UTC, end at Tue 2021-11-23 09:16:26 UTC. -- Nov 23 08:50:36.232670 dv-cinder-768458-17-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 23 08:50:36.241153 dv-cinder-768458-17-iscsi devstack@n-api.service[101848]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 23 08:50:36.243935 dv-cinder-768458-17-iscsi devstack@n-api.service[101848]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Nov 23 08:50:36 2021] *** Nov 23 08:50:36.243935 dv-cinder-768458-17-iscsi devstack@n-api.service[101848]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 23 08:50:36.243935 dv-cinder-768458-17-iscsi devstack@n-api.service[101848]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 23 08:50:36.243935 dv-cinder-768458-17-iscsi devstack@n-api.service[101848]: nodename: dv-cinder-768458-17-iscsi Nov 23 08:50:36.243935 dv-cinder-768458-17-iscsi devstack@n-api.service[101848]: machine: x86_64 Nov 23 08:50:36.243935 dv-cinder-768458-17-iscsi devstack@n-api.service[101848]: clock source: unix Nov 23 08:50:36.243935 dv-cinder-768458-17-iscsi devstack@n-api.service[101848]: pcre jit disabled Nov 23 08:50:36.243935 dv-cinder-768458-17-iscsi devstack@n-api.service[101848]: detected number of CPU cores: 4 Nov 23 08:50:36.243935 dv-cinder-768458-17-iscsi devstack@n-api.service[101848]: current working directory: / Nov 23 08:50:36.243935 dv-cinder-768458-17-iscsi devstack@n-api.service[101848]: detected binary path: /usr/bin/uwsgi-core Nov 23 08:50:36.243935 dv-cinder-768458-17-iscsi devstack@n-api.service[101848]: your processes number limit is 47680 Nov 23 08:50:36.243935 dv-cinder-768458-17-iscsi devstack@n-api.service[101848]: your memory page size is 4096 bytes Nov 23 08:50:36.244748 dv-cinder-768458-17-iscsi devstack@n-api.service[101848]: detected max file descriptor number: 2048 Nov 23 08:50:36.244748 dv-cinder-768458-17-iscsi devstack@n-api.service[101848]: lock engine: pthread robust mutexes Nov 23 08:50:36.244748 dv-cinder-768458-17-iscsi devstack@n-api.service[101848]: thunder lock: enabled Nov 23 08:50:36.244748 dv-cinder-768458-17-iscsi devstack@n-api.service[101848]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 23 08:50:36.244748 dv-cinder-768458-17-iscsi devstack@n-api.service[101848]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 23 08:50:36.287040 dv-cinder-768458-17-iscsi devstack@n-api.service[101848]: Python main interpreter initialized at 0x561b386069c0 Nov 23 08:50:36.287040 dv-cinder-768458-17-iscsi devstack@n-api.service[101848]: python threads support enabled Nov 23 08:50:36.287040 dv-cinder-768458-17-iscsi devstack@n-api.service[101848]: your server socket listen backlog is limited to 100 connections Nov 23 08:50:36.287040 dv-cinder-768458-17-iscsi devstack@n-api.service[101848]: your mercy for graceful operations on workers is 90 seconds Nov 23 08:50:36.287379 dv-cinder-768458-17-iscsi devstack@n-api.service[101848]: mapped 403077 bytes (393 KB) for 2 cores Nov 23 08:50:36.287456 dv-cinder-768458-17-iscsi devstack@n-api.service[101848]: *** Operational MODE: preforking *** Nov 23 08:50:36.287707 dv-cinder-768458-17-iscsi devstack@n-api.service[101848]: *** uWSGI is running in multiple interpreter mode *** Nov 23 08:50:36.287707 dv-cinder-768458-17-iscsi devstack@n-api.service[101848]: spawned uWSGI master process (pid: 101848) Nov 23 08:50:36.287902 dv-cinder-768458-17-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 23 08:50:36.288566 dv-cinder-768458-17-iscsi devstack@n-api.service[101848]: spawned uWSGI worker 1 (pid: 101849, cores: 1) Nov 23 08:50:36.290409 dv-cinder-768458-17-iscsi devstack@n-api.service[101848]: spawned uWSGI worker 2 (pid: 101850, cores: 1) Nov 23 08:50:36.290409 dv-cinder-768458-17-iscsi devstack@n-api.service[101848]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 23 08:50:37.870034 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 08:50:37.870034 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: from cryptography.utils import int_from_bytes Nov 23 08:50:37.870681 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 08:50:37.870681 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: from cryptography.utils import int_from_bytes Nov 23 08:50:37.872471 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 08:50:37.872471 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: from cryptography.utils import int_from_bytes Nov 23 08:50:37.872957 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 08:50:37.872957 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: from cryptography.utils import int_from_bytes Nov 23 08:50:40.364101 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 23 08:50:40.364600 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 23 08:50:40.364761 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 23 08:50:40.365090 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 23 08:50:40.365507 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 23 08:50:40.365507 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 23 08:50:40.365682 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 23 08:50:40.365763 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.365846 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 23 08:50:40.366050 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.366192 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 23 08:50:40.366365 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.366451 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 23 08:50:40.366679 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.366811 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.367008 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.367159 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.367340 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.367481 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.367658 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.367798 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.367973 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.368125 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.368301 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.368431 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.368559 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.368748 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.368870 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.369064 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.369209 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-768458-17-iscsi {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.369415 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.369532 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.369670 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.369838 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.369981 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.370143 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.370303 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-768458-17-iscsi {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.370461 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.370621 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.370764 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.370922 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.371083 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.371230 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.371388 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.371546 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.371847 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.371933 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.372165 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.372306 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.372469 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.372613 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.372922 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.372997 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.373336 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.373449 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.373603 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.373699 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.373909 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.374005 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.374232 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.374386 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.374535 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.374663 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.374839 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.374967 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.375176 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.375290 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.375448 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.375575 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-768458-17-iscsi {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.375769 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.375914 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.376075 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.376203 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.376431 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.376557 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-768458-17-iscsi {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.376768 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.376894 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.377083 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.377275 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.377417 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.377549 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.377756 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.377883 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.378076 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.378211 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.378380 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.378507 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.378702 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.378829 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.379018 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.379147 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.379320 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.379446 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.379637 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.379770 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.379936 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.380063 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.380240 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.380366 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.380544 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.380680 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.380845 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.380970 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.381148 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.381306 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.381473 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.381613 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.381748 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.381880 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.382010 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.382134 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.382313 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.382442 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.382593 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.382739 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.382903 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.383029 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.383196 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.383325 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.383448 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.383579 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.383743 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.383880 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.384061 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.384192 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.384397 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.384525 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.384657 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.384795 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.384919 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.385044 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.385218 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.385348 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.385525 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.385652 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.385827 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.385953 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.386126 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.386259 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.386427 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.386553 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.386730 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.386856 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.387031 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.387165 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.387334 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.387469 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.387635 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.387760 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.387941 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.388065 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.388256 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.388383 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.388559 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.388686 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.388861 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.388986 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.389211 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.389359 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.389510 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.389637 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.389813 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.389948 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.390126 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.390252 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.390442 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.390579 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.390743 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.390880 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.391042 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.391168 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.391344 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.391470 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.391648 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.391786 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.391948 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.392075 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.392247 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.392381 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.392504 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.392642 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.392768 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.392897 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.393067 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.393240 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.393403 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.393531 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.393706 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.393839 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.394005 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.394137 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.394312 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.394524 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.394654 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.394785 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.394908 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.395034 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.395166 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.395295 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.395459 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.395587 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.395759 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.395887 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.396058 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.396185 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.396354 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.396480 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.396652 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.396792 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.396951 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.397077 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.397253 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.397387 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.397557 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.397693 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.397857 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.397992 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.398156 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.398289 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.398993 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.399130 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.399311 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.399438 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.399612 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.399740 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.399913 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.400119 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.400244 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.400376 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.400500 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.400635 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.400798 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.400934 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.401097 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.401281 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.401420 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.401545 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.401725 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.401860 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.402025 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.402154 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.402322 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.402450 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.402635 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.402769 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.402934 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.403069 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.403235 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.403360 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.403546 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.403682 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.403841 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.403966 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.404140 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.404267 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.404438 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.404644 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.404771 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.404893 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.405028 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.405152 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.405319 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.405443 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.405618 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.405749 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.405914 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.406040 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.406210 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.406345 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.406507 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.406634 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.406805 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.406942 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.407099 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.407234 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.407399 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.407525 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.407699 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.407826 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.408002 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.408127 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.408302 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.408437 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.408600 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.408735 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.408912 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:50:40.409049 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.409258 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.409398 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.409584 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.409720 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.409907 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.410041 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.410216 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.410349 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.410521 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.410656 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.410827 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.410980 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.411147 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.411275 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.411448 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.411585 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.411750 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.411876 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.412055 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.412183 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.412358 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.412485 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.412664 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.412791 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.412970 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.413105 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.413303 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.413432 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.413612 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.413749 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.413925 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.414632 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.414843 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.415039 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.415178 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.415365 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.415492 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.415696 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.415834 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.416018 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.416147 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.416329 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.416457 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.416668 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.416806 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.416994 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.417121 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.417328 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.417454 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.417654 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.417783 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.417962 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.418090 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.418281 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.418408 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.418588 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.418715 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.418898 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.419027 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.419203 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.419329 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.419511 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.419646 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.419820 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.419948 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.420124 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.420250 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.420457 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.420585 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.420770 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.420899 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.421082 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.421244 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.421410 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.421538 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.421715 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.421843 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.422018 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.422227 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.422353 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.422477 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.422600 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.422723 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.422916 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.423057 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.423233 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.423360 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.423536 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.423668 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.423863 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.423999 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.424164 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.424297 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.424470 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.424607 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.424778 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.424982 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.425118 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.425274 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.425399 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.425512 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.425687 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.425815 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.425986 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.426112 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.426288 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.426422 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.426589 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.426724 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.426889 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.427022 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.427199 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.427327 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.427500 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.427627 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.427803 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.427932 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.428104 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.428239 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.428406 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.428533 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.428712 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.428846 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.429017 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.429155 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.429346 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.429473 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.429677 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.429804 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.429986 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.430190 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.430327 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.430505 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.430633 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.430815 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.431021 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.431165 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.431291 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.431456 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.431590 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.431758 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.431895 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.432079 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.432214 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.432397 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.432525 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.432695 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.432832 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.432994 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.433122 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.433305 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.433429 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.433607 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.433749 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.433905 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.434032 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.434203 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.434329 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.434504 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.434641 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.434802 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.434936 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.435141 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.435267 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.435401 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.435526 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.435669 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.435804 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.435966 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.436094 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.436267 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.436400 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.436565 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.436692 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.436861 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.436986 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.437176 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.437306 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.437477 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.437596 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.437813 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.437941 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.438113 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.438241 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.438450 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.438577 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.438760 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.438895 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.439073 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.439204 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.439380 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.439515 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.439684 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.439838 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.439987 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.440114 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.440291 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.440424 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.440600 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.440736 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.440906 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.441040 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.441242 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.441383 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.441551 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.441691 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.441872 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.442001 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.442178 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.442313 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.442485 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.442621 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.442785 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.442917 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.443095 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.443222 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.443411 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.443538 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.443712 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.443846 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.444020 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.444149 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.444349 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.444482 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.444663 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.444791 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.444971 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.445119 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.445393 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.445614 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.445736 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.445924 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.446058 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.446229 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.446366 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.446533 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.446660 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.446836 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.446962 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.447142 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.447278 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.447454 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.447580 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.447756 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.447882 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.448067 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.448202 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.448370 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.448498 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.448683 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.448809 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.448986 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.449114 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.449321 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.449458 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.449645 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.449773 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.449972 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.450102 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.450277 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.450417 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.450585 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.450714 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.450919 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.451046 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.451195 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.451324 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.451504 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.451640 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.451810 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.451938 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.452111 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.452239 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.452412 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.452549 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.452718 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.452846 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.453015 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.453142 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.453389 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.453533 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.453673 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.453945 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.454072 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.454250 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.454376 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.454547 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.454675 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.454851 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.454977 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.455150 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.455285 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.455497 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.455626 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.455760 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.455883 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.456029 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.456166 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.456336 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.456470 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.456639 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.456768 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.456956 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.457092 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.457271 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.457398 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.457570 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.457700 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.457870 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.458006 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.458179 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.458306 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.458478 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.458604 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.458776 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.458903 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.459071 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.459197 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.459370 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.459497 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.459700 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.459829 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.460000 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.460134 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.460312 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.460439 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.460621 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.460748 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.461482 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.461614 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.461790 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.461920 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.462169 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.462303 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.462479 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.462607 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.462799 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.462938 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.463110 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.463238 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.463415 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.463542 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.463721 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.463859 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.464030 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.464165 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.464335 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.464469 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.464638 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.464774 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.464943 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.465071 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.465272 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.465401 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.465619 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.465757 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.465889 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.466011 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.466160 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.466290 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.466461 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.466591 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.466767 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.466895 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.467079 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.467328 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.467635 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.467764 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.467951 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.468084 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.468260 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.468387 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.468573 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.468701 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.468885 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.469012 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.469226 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.469360 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.469549 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.469677 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.469858 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.469986 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.470160 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.470298 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.470456 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.470582 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.470757 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.470883 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.471056 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.471195 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.471355 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.471483 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.471654 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.471780 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.471952 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.472088 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.472249 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.472377 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.472546 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.472672 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.472843 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.472978 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.473141 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.473295 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.473463 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.473592 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.473777 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.473918 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.474085 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.474223 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.474385 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.474524 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.474681 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.474814 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.474979 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.475186 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.475313 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.475435 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.475657 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.475803 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.475934 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.476061 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.476187 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.476310 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.476443 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.477314 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.477500 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.477646 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.477777 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.477907 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.478034 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.478150 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.478359 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.478490 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.478685 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.478812 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.478988 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.479123 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.479291 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.479420 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.479596 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.479724 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.479900 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.480037 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.480202 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.480330 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.480498 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.480624 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.480797 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.480940 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.481097 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.481250 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.481422 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.481548 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.481722 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.481864 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.482025 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.482152 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.482327 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.482456 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.482630 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.482774 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.482927 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.483055 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.483220 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.483353 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.483519 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.483658 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.483814 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.483942 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.484120 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.484273 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.484408 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.484533 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.484704 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.484831 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.485002 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.485130 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.485372 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.485504 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.485628 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.485851 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.485981 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.486113 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.486268 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.486394 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.486517 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.486641 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.486772 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.486897 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.487057 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.487187 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.487353 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.487480 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.487648 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.487783 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.487950 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.488105 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.488248 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.488381 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.488545 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.488681 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.488859 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.488989 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.489204 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.489337 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.489482 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.489622 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.489780 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.489914 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.490061 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.490187 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.490361 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.490498 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.490656 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.490783 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.490958 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.491087 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.491273 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.491400 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.491573 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.491708 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.491868 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.492003 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.492193 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.492361 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.492487 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.492618 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.492778 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.492930 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.493068 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.493257 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.493388 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.493563 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.493691 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.493863 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.494009 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.494168 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.494297 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.494468 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.494595 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.494770 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.494906 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.495068 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.495203 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.495385 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.495521 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.495689 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.495832 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.496024 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.496159 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.496274 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.496406 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.496541 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.496666 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.496877 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.497005 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.497192 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.497323 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.497549 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.497679 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.497850 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.497979 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.498154 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.498289 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.498461 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.498591 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.498765 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.498891 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.499062 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.499197 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.499368 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.499494 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.499670 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.499798 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.499975 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.500114 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.500274 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.500401 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.500574 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.500704 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.500871 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.501007 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.501192 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.501322 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.501498 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.501626 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.501808 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.501943 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.502113 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.502241 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.502428 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.502553 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.502726 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.502855 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.503031 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.503159 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.503332 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.503459 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.503656 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.503789 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.503915 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.504039 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.504213 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.504341 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.504514 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.504642 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.504818 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.504946 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.505119 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.505265 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.505446 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.505574 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.505750 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.505876 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.506081 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.506224 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.506351 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.506473 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.506634 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.506770 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.506934 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.507070 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.507236 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.507362 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.507539 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.507667 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.507862 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.507997 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.508168 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.508338 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.508467 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.508646 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.508793 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.508952 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.509088 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.509268 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.509481 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.509609 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.509788 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.510095 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.510395 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.510700 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.511004 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.511313 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.511622 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.511919 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.512329 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.512633 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.512938 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.513264 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.513566 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.513835 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.513964 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.514156 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.514325 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.514471 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.514672 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.514800 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.515009 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.515138 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.515330 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.515470 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.515652 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.515781 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.515951 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.516086 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.516290 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.516429 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.516602 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.516728 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.516919 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.517048 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.517261 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.517403 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.517676 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.517804 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.517986 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.518114 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.518291 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.518419 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.518599 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.518725 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.518909 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.519037 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.519224 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.519353 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.519521 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.519648 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.519830 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.519957 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.520134 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.520470 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.520470 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.520692 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.520799 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.520913 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.521050 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.521197 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.521382 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.521510 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.521683 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.521881 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.522022 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.522198 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.522335 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.522507 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.522635 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.522903 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.523033 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.523221 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.523865 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.524145 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.524290 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.524482 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.524612 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.524744 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.524877 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.525060 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.525237 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.525380 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.525505 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.525671 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.525806 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.525977 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.526113 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.526338 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.526476 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.526600 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.526732 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.526881 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.527017 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.527149 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.527274 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.527458 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.527595 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.527762 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.527891 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.528064 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.528205 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.528361 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.528491 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.528660 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.528788 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.528978 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.529209 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.529342 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.529536 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.529677 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.529846 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.529975 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.530167 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.530297 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.530487 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.530615 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.530787 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.530961 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.531090 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.531213 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.531387 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.531516 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.531683 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.531823 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.531981 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.532112 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.532279 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.532415 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.532592 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.532731 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.532899 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.533034 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.533225 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.533354 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.533534 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.533674 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.533835 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.533964 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.534136 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.534266 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.534456 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.534589 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.534756 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.534892 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.535069 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.535197 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.535378 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.535512 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.535680 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.535808 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.535981 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.536108 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.536284 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.536426 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.536641 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.536770 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.536901 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.537034 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.537198 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.537326 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.537452 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.537577 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.537748 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.537892 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.538046 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.538174 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.538342 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.538497 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.538624 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.538757 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.538963 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.539633 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.539924 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.540060 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.540233 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.540376 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.540548 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.540677 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.540855 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.540985 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.541198 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.541338 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.541485 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.541622 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.541807 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.541942 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.542111 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.542240 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.542412 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.542543 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.542718 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.542847 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.543018 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.543148 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.543318 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.543447 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.543621 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.543750 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.543925 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.544054 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.544225 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.544354 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.544525 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.544653 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.544956 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.545105 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.545253 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.545380 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.545504 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.545641 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.545770 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.545899 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.546045 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.546174 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.546349 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.546486 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.546634 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.546830 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.546968 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.547095 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.547244 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.547381 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.547549 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.547768 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.547907 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.548095 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.548224 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.548407 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.548551 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.548715 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.548852 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.549023 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.549214 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.549343 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.549480 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.549652 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.549790 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.549957 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.550100 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.550265 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.550401 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.550570 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.550707 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.550875 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.551015 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.551198 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.551334 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.551505 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.551633 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.551810 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.552019 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.552147 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.552272 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.552418 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.552547 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.552727 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.552856 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.553035 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.553274 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.553407 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.553602 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.553741 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.553913 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.554043 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.554224 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.554353 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.554532 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.554708 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.554865 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.554992 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.555164 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.555384 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.555521 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.555696 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.555827 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.556004 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.556134 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.556321 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.556467 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.556631 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.556760 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.556978 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.557122 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.557306 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.557442 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.557576 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.557702 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.557848 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.557985 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.558169 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.558299 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.558500 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.558636 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.558815 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.558943 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.559140 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.559275 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.559405 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.559529 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.559720 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.559862 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.560050 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.560235 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.560371 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.560546 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.560675 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.560875 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.561004 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.561216 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.561349 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.561540 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.561669 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.561852 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.561982 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.562158 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.562292 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.562465 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.562604 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.562768 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.562895 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.563070 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.563199 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.563376 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.563513 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.563681 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.563817 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.563983 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.564111 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.564299 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.564436 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.564601 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.564738 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.564902 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.565030 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.565242 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.565440 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.565570 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.565752 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.566067 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.566198 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.566388 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.566516 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.566707 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.566844 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.567061 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.567204 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.567339 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.567465 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.567631 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.567770 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.567932 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.568060 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.568234 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.568365 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.568537 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.568664 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.568838 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.568985 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.569136 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.569287 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.569463 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.569603 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.569765 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.569905 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.570063 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.570229 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.570557 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.570687 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.570869 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.571011 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.571207 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.571398 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.571527 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.571743 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.571872 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.572129 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.572259 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.572440 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.572568 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.572749 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.572886 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.573052 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.573250 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.573389 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.573515 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.573674 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.573811 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.573974 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.574104 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.574276 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.574404 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.574575 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.574712 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.574881 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.575008 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.575180 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.575317 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.575478 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.575615 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.575778 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.575905 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.576081 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.576210 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.576381 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.576523 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.576686 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.576813 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.576983 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.577125 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.577362 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.577491 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.577616 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.577740 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.577902 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.578030 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.578201 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.578330 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.578509 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.578652 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.578808 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.578936 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.579108 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.579234 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.579405 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.579535 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.579706 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.579847 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.580017 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.580147 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.580321 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.580566 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.580695 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.580946 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.581122 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.581298 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.581620 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.581743 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.581963 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.582101 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.582272 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.582402 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.582576 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.582703 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.582879 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.583016 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.583191 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.583326 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.583493 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.583634 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.583801 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.583929 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.584106 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.584233 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.584412 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.584540 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.584721 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.584851 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.585026 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.585153 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.585354 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.585483 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.585662 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.585791 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.586500 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.586747 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.586887 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.587126 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.587264 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.587470 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.587598 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.587751 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.587878 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.588064 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.588201 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.588379 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.588509 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.588685 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.588813 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.589027 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.589189 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.589311 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.589446 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.589605 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.589735 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.589921 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.590049 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.590228 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.590358 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.590536 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.590675 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.590839 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.590968 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.591143 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.591275 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.591449 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.591587 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.591755 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.591885 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.592063 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.592199 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.592374 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.592516 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.592711 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.592841 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.593024 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.593179 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.593364 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.593495 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.593681 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.593809 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.593989 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.594127 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.594294 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.594423 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.594601 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.594731 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.594908 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.595046 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.595215 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.595344 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.595525 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.595664 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.595827 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.595955 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.596131 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.596260 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.596438 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.596567 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.596769 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.596911 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.597099 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.597247 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.597445 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.597640 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.597768 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.597906 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.598033 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.598158 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.598353 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.598482 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.598659 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.598798 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.598977 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.599106 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.599294 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.599414 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.599603 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.599732 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.599908 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.600036 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.600239 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.600370 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.600548 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.600685 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.600858 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.600988 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.601179 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.601310 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.601542 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.602176 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.602361 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.602492 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.602703 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.602847 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.603034 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.603171 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.603367 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.603504 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.603680 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.603819 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.604000 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.604137 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.604309 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.604438 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.604630 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.604769 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.604938 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.605075 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.605280 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.605411 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.605602 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.605733 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.605910 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.606038 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.606214 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.606342 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.606523 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.606652 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.606836 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.606965 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.607142 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.607277 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.607453 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.607590 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.607798 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.607927 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.608053 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.608178 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.608343 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.608474 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.608666 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.608808 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.608993 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.609135 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.609328 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.609451 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.609651 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.609781 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.609966 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.610103 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.610280 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.610409 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.610585 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.610712 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.610889 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.611026 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.611153 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 23 08:50:40.611278 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.611507 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.611821 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.612129 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.612436 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.612747 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.613058 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.613408 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.613732 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.614055 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.614424 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.614722 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.615031 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.615373 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.615698 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.616009 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.616316 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.616619 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:50:40.616857 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 23 08:50:40.633452 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG oslo_db.sqlalchemy.engines [None req-031f946f-beb5-4353-a51d-4255253c119e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101850) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 08:50:40.638704 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG oslo_db.sqlalchemy.engines [None req-4b09ae59-175f-4d05-879b-d5d1ead5a341 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101849) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 08:50:40.699661 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.context [None req-031f946f-beb5-4353-a51d-4255253c119e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),848a0ecb-e389-4eb0-b537-075130526b9c(cell1) {{(pid=101850) load_cells /opt/stack/nova/nova/context.py:464}} Nov 23 08:50:40.703860 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG oslo_concurrency.lockutils [None req-031f946f-beb5-4353-a51d-4255253c119e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:50:40.705434 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG oslo_concurrency.lockutils [None req-031f946f-beb5-4353-a51d-4255253c119e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:50:40.706138 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.context [None req-4b09ae59-175f-4d05-879b-d5d1ead5a341 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),848a0ecb-e389-4eb0-b537-075130526b9c(cell1) {{(pid=101849) load_cells /opt/stack/nova/nova/context.py:464}} Nov 23 08:50:40.706264 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG oslo_concurrency.lockutils [None req-031f946f-beb5-4353-a51d-4255253c119e None None] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:50:40.708150 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG oslo_concurrency.lockutils [None req-031f946f-beb5-4353-a51d-4255253c119e None None] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:50:40.710293 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG oslo_concurrency.lockutils [None req-4b09ae59-175f-4d05-879b-d5d1ead5a341 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:50:40.712639 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG oslo_concurrency.lockutils [None req-4b09ae59-175f-4d05-879b-d5d1ead5a341 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:50:40.713483 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG oslo_concurrency.lockutils [None req-4b09ae59-175f-4d05-879b-d5d1ead5a341 None None] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:50:40.715488 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG oslo_concurrency.lockutils [None req-4b09ae59-175f-4d05-879b-d5d1ead5a341 None None] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:50:40.719165 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG oslo_db.sqlalchemy.engines [None req-031f946f-beb5-4353-a51d-4255253c119e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101850) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 08:50:40.721672 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG oslo_db.sqlalchemy.engines [None req-031f946f-beb5-4353-a51d-4255253c119e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101850) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 08:50:40.729338 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG oslo_db.sqlalchemy.engines [None req-4b09ae59-175f-4d05-879b-d5d1ead5a341 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101849) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 08:50:40.731484 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG oslo_db.sqlalchemy.engines [None req-4b09ae59-175f-4d05-879b-d5d1ead5a341 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101849) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 08:50:40.975001 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG oslo_db.sqlalchemy.engines [None req-031f946f-beb5-4353-a51d-4255253c119e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101850) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 08:50:40.983518 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG oslo_db.sqlalchemy.engines [None req-4b09ae59-175f-4d05-879b-d5d1ead5a341 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101849) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 08:50:41.317785 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: WARNING keystonemiddleware.auth_token [None req-4b09ae59-175f-4d05-879b-d5d1ead5a341 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 08:50:41.320646 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: WARNING keystonemiddleware.auth_token [None req-031f946f-beb5-4353-a51d-4255253c119e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 08:50:41.324460 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: WARNING keystonemiddleware.auth_token [None req-4b09ae59-175f-4d05-879b-d5d1ead5a341 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 08:50:41.327092 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: WARNING keystonemiddleware.auth_token [None req-031f946f-beb5-4353-a51d-4255253c119e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 08:50:41.544907 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: WARNING keystonemiddleware.auth_token [None req-4b09ae59-175f-4d05-879b-d5d1ead5a341 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 08:50:41.550023 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: WARNING keystonemiddleware.auth_token [None req-4b09ae59-175f-4d05-879b-d5d1ead5a341 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 08:50:41.550980 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: WARNING keystonemiddleware.auth_token [None req-031f946f-beb5-4353-a51d-4255253c119e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 08:50:41.555432 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561b386069c0 pid: 101849 (default app) Nov 23 08:50:41.556151 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: WARNING keystonemiddleware.auth_token [None req-031f946f-beb5-4353-a51d-4255253c119e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 08:50:41.557484 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-4b09ae59-175f-4d05-879b-d5d1ead5a341 None None] Calling method '>' {{(pid=101849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:50:41.558635 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.requestlog [None req-4b09ae59-175f-4d05-879b-d5d1ead5a341 None None] 10.222.0.46 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001725 Nov 23 08:50:41.559047 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: [pid: 101849|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 788 bytes} [Tue Nov 23 08:50:41 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:50:41.561512 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561b386069c0 pid: 101850 (default app) Nov 23 08:52:02.815875 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-4b09ae59-175f-4d05-879b-d5d1ead5a341 None None] Calling method '>' {{(pid=101849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:52:02.817463 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.requestlog [None req-4b09ae59-175f-4d05-879b-d5d1ead5a341 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001971 Nov 23 08:52:02.817862 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: [pid: 101849|app: 0|req: 2/2] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 23 08:52:02 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:52:03.349972 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-8ea7841a-b07c-44f9-b374-4b7bd6bea951 admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:52:03.379945 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-8ea7841a-b07c-44f9-b374-4b7bd6bea951 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.554880 Nov 23 08:52:03.380732 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 1/3] 10.222.0.46 () {60 vars in 1291 bytes} [Tue Nov 23 08:52:02 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:52:05.739326 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-4b09ae59-175f-4d05-879b-d5d1ead5a341 None None] Calling method '>' {{(pid=101849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:52:05.740366 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.requestlog [None req-4b09ae59-175f-4d05-879b-d5d1ead5a341 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Nov 23 08:52:05.740771 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: [pid: 101849|app: 0|req: 3/4] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 23 08:52:05 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:52:05.821465 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-4e80bc58-885d-4741-b484-130032b02338 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1, "vcpus": 1, "os-flavor-access:is_public": true, "id": "c1", "name": "cirros256", "swap": 0}} {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:52:05.848442 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 08:52:05.848442 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: warnings.warn(msg) Nov 23 08:52:05.876232 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-4e80bc58-885d-4741-b484-130032b02338 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.129020 Nov 23 08:52:05.876797 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 2/5] 10.222.0.46 () {64 vars in 1282 bytes} [Tue Nov 23 08:52:05 2021] POST /compute/v2.1/flavors => generated 407 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 08:52:06.211053 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-232baf62-87a3-46ab-9b21-0c712b48c3af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:52:06.213413 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 08:52:06.213413 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: warnings.warn(msg) Nov 23 08:52:06.287090 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.requestlog [None req-232baf62-87a3-46ab-9b21-0c712b48c3af admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.401228 Nov 23 08:52:06.287794 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: [pid: 101849|app: 0|req: 4/6] 10.222.0.46 () {64 vars in 1335 bytes} [Tue Nov 23 08:52:05 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:52:08.594977 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-4e80bc58-885d-4741-b484-130032b02338 admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:52:08.595989 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-4e80bc58-885d-4741-b484-130032b02338 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Nov 23 08:52:08.596388 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 3/7] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 23 08:52:08 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:52:08.708150 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-2247a429-f56a-46ed-b846-d1d5f9f0ade9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "rxtx_factor": 1.0, "name": "ds512M", "swap": 0, "disk": 5, "ram": 512, "os-flavor-access:is_public": true}} {{(pid=101849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:52:08.726223 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 08:52:08.726223 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: warnings.warn(msg) Nov 23 08:52:08.746439 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.requestlog [None req-2247a429-f56a-46ed-b846-d1d5f9f0ade9 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.142627 Nov 23 08:52:08.747188 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: [pid: 101849|app: 0|req: 5/8] 10.222.0.46 () {64 vars in 1282 bytes} [Tue Nov 23 08:52:08 2021] POST /compute/v2.1/flavors => generated 404 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 08:52:08.759097 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-be938360-3cf2-4178-80bb-76873faaf0ae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:52:08.761002 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 08:52:08.761002 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: warnings.warn(msg) Nov 23 08:52:08.799038 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-be938360-3cf2-4178-80bb-76873faaf0ae admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043468 Nov 23 08:52:08.800212 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 4/9] 10.222.0.46 () {64 vars in 1335 bytes} [Tue Nov 23 08:52:08 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:52:11.109762 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-2247a429-f56a-46ed-b846-d1d5f9f0ade9 admin admin] Calling method '>' {{(pid=101849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:52:11.110892 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.requestlog [None req-2247a429-f56a-46ed-b846-d1d5f9f0ade9 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002039 Nov 23 08:52:11.111367 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: [pid: 101849|app: 0|req: 6/10] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 23 08:52:11 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:52:11.178773 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-054b6b48-9ffa-495f-b9ba-d7755f29c6d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "id": "d2", "disk": 10, "name": "ds1G"}} {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:52:11.200082 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-054b6b48-9ffa-495f-b9ba-d7755f29c6d9 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.081817 Nov 23 08:52:11.202134 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 5/11] 10.222.0.46 () {64 vars in 1282 bytes} [Tue Nov 23 08:52:11 2021] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 08:52:11.214327 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-355f2e06-ae8a-436d-8ab9-db967583cdb9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:52:11.236648 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.requestlog [None req-355f2e06-ae8a-436d-8ab9-db967583cdb9 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026027 Nov 23 08:52:11.237254 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: [pid: 101849|app: 0|req: 7/12] 10.222.0.46 () {64 vars in 1335 bytes} [Tue Nov 23 08:52:11 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:52:13.548680 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-054b6b48-9ffa-495f-b9ba-d7755f29c6d9 admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:52:13.549795 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-054b6b48-9ffa-495f-b9ba-d7755f29c6d9 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Nov 23 08:52:13.550236 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 6/13] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 23 08:52:13 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:52:13.619864 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-cdc7d2fd-03cc-408f-aa49-bdd6c1eadc13 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "id": "d3", "swap": 0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=101849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:52:13.649131 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.requestlog [None req-cdc7d2fd-03cc-408f-aa49-bdd6c1eadc13 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.090245 Nov 23 08:52:13.649715 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: [pid: 101849|app: 0|req: 8/14] 10.222.0.46 () {64 vars in 1282 bytes} [Tue Nov 23 08:52:13 2021] POST /compute/v2.1/flavors => generated 404 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 08:52:13.662760 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-c8beaeb5-48bd-444e-bd2c-2902319abcc5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:52:13.687985 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-c8beaeb5-48bd-444e-bd2c-2902319abcc5 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029514 Nov 23 08:52:13.688751 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 7/15] 10.222.0.46 () {64 vars in 1335 bytes} [Tue Nov 23 08:52:13 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:52:15.994898 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-cdc7d2fd-03cc-408f-aa49-bdd6c1eadc13 admin admin] Calling method '>' {{(pid=101849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:52:15.995900 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.requestlog [None req-cdc7d2fd-03cc-408f-aa49-bdd6c1eadc13 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Nov 23 08:52:15.996301 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: [pid: 101849|app: 0|req: 9/16] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 23 08:52:15 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:52:16.055103 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-cfc8d393-49d9-4da4-9d63-c23e7382fd61 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 4096, "vcpus": 4, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "id": "d4", "rxtx_factor": 1.0}} {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:52:16.073013 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-cfc8d393-49d9-4da4-9d63-c23e7382fd61 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070245 Nov 23 08:52:16.073853 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 8/17] 10.222.0.46 () {64 vars in 1282 bytes} [Tue Nov 23 08:52:16 2021] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 08:52:16.087479 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-8f004d92-a7bc-498f-97ef-b6d1f0a08cb8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:52:16.118511 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.requestlog [None req-8f004d92-a7bc-498f-97ef-b6d1f0a08cb8 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035540 Nov 23 08:52:16.119529 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: [pid: 101849|app: 0|req: 10/18] 10.222.0.46 () {64 vars in 1335 bytes} [Tue Nov 23 08:52:16 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:52:18.465861 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-cfc8d393-49d9-4da4-9d63-c23e7382fd61 admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:52:18.467174 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-cfc8d393-49d9-4da4-9d63-c23e7382fd61 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001962 Nov 23 08:52:18.467746 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 9/19] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 23 08:52:18 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:52:18.530928 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-1c91b86a-54d8-43b0-9d03-18750f0180a9 admin admin] Calling method '>' {{(pid=101849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:52:18.563656 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.requestlog [None req-1c91b86a-54d8-43b0-9d03-18750f0180a9 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.088131 Nov 23 08:52:18.564354 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: [pid: 101849|app: 0|req: 11/20] 10.222.0.46 () {60 vars in 1291 bytes} [Tue Nov 23 08:52:18 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 08:52:21.173571 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-cfc8d393-49d9-4da4-9d63-c23e7382fd61 admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:52:21.175653 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-cfc8d393-49d9-4da4-9d63-c23e7382fd61 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001975 Nov 23 08:52:21.176116 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 10/21] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 23 08:52:21 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:52:21.242035 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-eefd0aa2-d7e9-4613-8008-03c096641363 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "vcpus": 1, "ram": 512, "disk": 1, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0}} {{(pid=101849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:52:21.263952 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.requestlog [None req-eefd0aa2-d7e9-4613-8008-03c096641363 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.081363 Nov 23 08:52:21.264671 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: [pid: 101849|app: 0|req: 12/22] 10.222.0.46 () {64 vars in 1282 bytes} [Tue Nov 23 08:52:21 2021] POST /compute/v2.1/flavors => generated 402 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 08:52:21.277630 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-936fe079-a5db-4706-bdf2-9947927b4e5b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:52:21.299404 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-936fe079-a5db-4706-bdf2-9947927b4e5b admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025460 Nov 23 08:52:21.305184 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 11/23] 10.222.0.46 () {64 vars in 1332 bytes} [Tue Nov 23 08:52:21 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:52:23.600708 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-eefd0aa2-d7e9-4613-8008-03c096641363 admin admin] Calling method '>' {{(pid=101849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:52:23.602201 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.requestlog [None req-eefd0aa2-d7e9-4613-8008-03c096641363 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002023 Nov 23 08:52:23.602932 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: [pid: 101849|app: 0|req: 13/24] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 23 08:52:23 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:52:23.668997 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-43531067-b706-469e-bbae-e513c0ec28c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "2", "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:52:23.687158 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-43531067-b706-469e-bbae-e513c0ec28c5 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078112 Nov 23 08:52:23.687721 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 12/25] 10.222.0.46 () {64 vars in 1282 bytes} [Tue Nov 23 08:52:23 2021] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 08:52:23.700187 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-ce9827b6-80cb-4df3-908f-abbb87572212 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:52:23.724786 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.requestlog [None req-ce9827b6-80cb-4df3-908f-abbb87572212 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028294 Nov 23 08:52:23.725640 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: [pid: 101849|app: 0|req: 14/26] 10.222.0.46 () {64 vars in 1332 bytes} [Tue Nov 23 08:52:23 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:52:26.001231 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-43531067-b706-469e-bbae-e513c0ec28c5 admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:52:26.002250 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-43531067-b706-469e-bbae-e513c0ec28c5 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Nov 23 08:52:26.003555 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 13/27] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 23 08:52:25 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 08:52:26.062662 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-032f5120-e04f-4a11-baef-70f6724119db admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "3", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 40, "swap": 0, "vcpus": 2, "name": "m1.medium"}} {{(pid=101849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:52:26.089541 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.requestlog [None req-032f5120-e04f-4a11-baef-70f6724119db admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.079517 Nov 23 08:52:26.090669 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: [pid: 101849|app: 0|req: 15/28] 10.222.0.46 () {64 vars in 1282 bytes} [Tue Nov 23 08:52:26 2021] POST /compute/v2.1/flavors => generated 406 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 08:52:26.104759 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-d972f553-5a39-4fc2-8d4b-2755d9acd561 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:52:26.136183 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-d972f553-5a39-4fc2-8d4b-2755d9acd561 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036284 Nov 23 08:52:26.136758 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 14/29] 10.222.0.46 () {64 vars in 1332 bytes} [Tue Nov 23 08:52:26 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:52:28.456498 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-032f5120-e04f-4a11-baef-70f6724119db admin admin] Calling method '>' {{(pid=101849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:52:28.457564 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.requestlog [None req-032f5120-e04f-4a11-baef-70f6724119db admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Nov 23 08:52:28.458312 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: [pid: 101849|app: 0|req: 16/30] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 23 08:52:28 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:52:28.520231 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-4df28e24-5d28-4600-bdf8-0b9b18e44686 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "4", "swap": 0, "ram": 8192, "disk": 80, "vcpus": 4, "rxtx_factor": 1.0, "name": "m1.large"}} {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:52:28.539208 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-4df28e24-5d28-4600-bdf8-0b9b18e44686 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074547 Nov 23 08:52:28.540050 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 15/31] 10.222.0.46 () {64 vars in 1282 bytes} [Tue Nov 23 08:52:28 2021] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 08:52:28.552470 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-7ed783a3-e998-463f-bba6-7339735c0662 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:52:28.574870 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.requestlog [None req-7ed783a3-e998-463f-bba6-7339735c0662 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026642 Nov 23 08:52:28.575485 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: [pid: 101849|app: 0|req: 17/32] 10.222.0.46 () {64 vars in 1332 bytes} [Tue Nov 23 08:52:28 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:52:31.006518 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-4df28e24-5d28-4600-bdf8-0b9b18e44686 admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:52:31.009426 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-4df28e24-5d28-4600-bdf8-0b9b18e44686 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003321 Nov 23 08:52:31.009907 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 16/33] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 23 08:52:31 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:52:31.075999 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-e8743890-2f27-4c9b-87d6-8d2c334712d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "id": "5", "ram": 16384, "name": "m1.xlarge", "rxtx_factor": 1.0}} {{(pid=101849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:52:31.095879 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.requestlog [None req-e8743890-2f27-4c9b-87d6-8d2c334712d6 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.079176 Nov 23 08:52:31.098762 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: [pid: 101849|app: 0|req: 18/34] 10.222.0.46 () {64 vars in 1282 bytes} [Tue Nov 23 08:52:31 2021] POST /compute/v2.1/flavors => generated 408 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 08:52:31.111125 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-730a5550-4bfa-4a31-a665-45680a77dc11 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:52:31.134751 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-730a5550-4bfa-4a31-a665-45680a77dc11 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027510 Nov 23 08:52:31.135609 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 17/35] 10.222.0.46 () {64 vars in 1332 bytes} [Tue Nov 23 08:52:31 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:52:52.421449 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-e8743890-2f27-4c9b-87d6-8d2c334712d6 admin admin] Calling method '>' {{(pid=101849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:52:52.422446 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.requestlog [None req-e8743890-2f27-4c9b-87d6-8d2c334712d6 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Nov 23 08:52:52.422840 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: [pid: 101849|app: 0|req: 19/36] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 23 08:52:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:52:52.480118 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-0a313bc9-fe0e-4e23-90b5-b0c470d0e0a7 admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:52:52.497062 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-0a313bc9-fe0e-4e23-90b5-b0c470d0e0a7 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.066903 Nov 23 08:52:52.497626 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 18/37] 10.222.0.46 () {60 vars in 1291 bytes} [Tue Nov 23 08:52:52 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 08:52:53.980078 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-e8743890-2f27-4c9b-87d6-8d2c334712d6 admin admin] Calling method '>' {{(pid=101849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:52:53.981069 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.requestlog [None req-e8743890-2f27-4c9b-87d6-8d2c334712d6 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001391 Nov 23 08:52:53.981498 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: [pid: 101849|app: 0|req: 20/38] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Nov 23 08:52:53 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:52:54.170892 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-5e09e18e-1c7d-4bb5-9709-a1a33b742dd0 admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:52:54.176700 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.wsgi [None req-5e09e18e-1c7d-4bb5-9709-a1a33b742dd0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 23 08:52:54.177286 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-5e09e18e-1c7d-4bb5-9709-a1a33b742dd0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 08:52:54.178064 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-5e09e18e-1c7d-4bb5-9709-a1a33b742dd0 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.058729 Nov 23 08:52:54.178574 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 19/39] 10.222.0.46 () {60 vars in 1190 bytes} [Tue Nov 23 08:52:54 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 23 08:52:54.188127 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-d27d4d69-004c-4610-91b4-d9097fbe0c8b admin admin] Calling method '>' {{(pid=101849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:52:54.209456 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.requestlog [None req-d27d4d69-004c-4610-91b4-d9097fbe0c8b admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024795 Nov 23 08:52:54.209985 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: [pid: 101849|app: 0|req: 21/40] 10.222.0.46 () {60 vars in 1210 bytes} [Tue Nov 23 08:52:54 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 08:52:54.221613 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-d203aeda-8002-4745-a46e-0a71d4218a75 admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:52:54.242400 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-d203aeda-8002-4745-a46e-0a71d4218a75 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024216 Nov 23 08:52:54.242936 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 20/41] 10.222.0.46 () {60 vars in 1210 bytes} [Tue Nov 23 08:52:54 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 08:52:54.253013 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-3e61d765-02a8-48e0-9f87-19e4e544f181 admin admin] Calling method '>' {{(pid=101849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:52:54.258401 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.wsgi [None req-3e61d765-02a8-48e0-9f87-19e4e544f181 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 23 08:52:54.258947 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-3e61d765-02a8-48e0-9f87-19e4e544f181 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 08:52:54.259719 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.requestlog [None req-3e61d765-02a8-48e0-9f87-19e4e544f181 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010703 Nov 23 08:52:54.260208 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: [pid: 101849|app: 0|req: 22/42] 10.222.0.46 () {60 vars in 1190 bytes} [Tue Nov 23 08:52:54 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 23 08:52:55.632005 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-d203aeda-8002-4745-a46e-0a71d4218a75 admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:52:55.633020 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-d203aeda-8002-4745-a46e-0a71d4218a75 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Nov 23 08:52:55.633454 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 21/43] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Nov 23 08:52:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:52:55.822672 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-96edc583-d3a5-4716-91db-4a1b9fd85a1c admin admin] Calling method '>' {{(pid=101849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:52:55.828225 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.wsgi [None req-96edc583-d3a5-4716-91db-4a1b9fd85a1c admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 23 08:52:55.828778 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-96edc583-d3a5-4716-91db-4a1b9fd85a1c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 08:52:55.830180 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.requestlog [None req-96edc583-d3a5-4716-91db-4a1b9fd85a1c admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.056965 Nov 23 08:52:55.830685 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: [pid: 101849|app: 0|req: 23/44] 10.222.0.46 () {60 vars in 1190 bytes} [Tue Nov 23 08:52:55 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 23 08:52:55.840412 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-f69bdaca-fe8c-4729-8e42-a321a5c87c3a admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:52:55.854184 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-f69bdaca-fe8c-4729-8e42-a321a5c87c3a admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017284 Nov 23 08:52:55.854697 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 22/45] 10.222.0.46 () {60 vars in 1210 bytes} [Tue Nov 23 08:52:55 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 08:52:55.864416 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-bb580012-a21d-453f-9215-aea196ce4959 admin admin] Calling method '>' {{(pid=101849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:52:55.877875 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.requestlog [None req-bb580012-a21d-453f-9215-aea196ce4959 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017022 Nov 23 08:52:55.878416 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: [pid: 101849|app: 0|req: 24/46] 10.222.0.46 () {60 vars in 1210 bytes} [Tue Nov 23 08:52:55 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 08:52:55.888074 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-712f3538-499f-4160-b71d-c8515c812c03 admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:52:55.893931 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.wsgi [None req-712f3538-499f-4160-b71d-c8515c812c03 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 23 08:52:55.894477 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-712f3538-499f-4160-b71d-c8515c812c03 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 08:52:55.895243 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-712f3538-499f-4160-b71d-c8515c812c03 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010638 Nov 23 08:52:55.895724 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 23/47] 10.222.0.46 () {60 vars in 1190 bytes} [Tue Nov 23 08:52:55 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 23 08:52:57.269420 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-bb580012-a21d-453f-9215-aea196ce4959 admin admin] Calling method '>' {{(pid=101849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:52:57.270426 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.requestlog [None req-bb580012-a21d-453f-9215-aea196ce4959 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Nov 23 08:52:57.270948 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: [pid: 101849|app: 0|req: 25/48] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Nov 23 08:52:57 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 08:52:57.459117 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-0deaead6-4528-4a38-a9c3-88e1821620b7 admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:52:57.464330 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.wsgi [None req-0deaead6-4528-4a38-a9c3-88e1821620b7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 23 08:52:57.464894 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-0deaead6-4528-4a38-a9c3-88e1821620b7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 08:52:57.465730 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-0deaead6-4528-4a38-a9c3-88e1821620b7 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057012 Nov 23 08:52:57.466242 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 24/49] 10.222.0.46 () {60 vars in 1193 bytes} [Tue Nov 23 08:52:57 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 23 08:52:57.476155 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-8d4a76b4-b92c-4b95-9f7c-060d61c3bcae admin admin] Calling method '>' {{(pid=101849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:52:57.489648 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.requestlog [None req-8d4a76b4-b92c-4b95-9f7c-060d61c3bcae admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017247 Nov 23 08:52:57.490159 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: [pid: 101849|app: 0|req: 26/50] 10.222.0.46 () {60 vars in 1210 bytes} [Tue Nov 23 08:52:57 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 08:52:57.500174 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-b271b5c0-a97e-4754-85f1-9423d6adf9ff admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:52:57.513810 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-b271b5c0-a97e-4754-85f1-9423d6adf9ff admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017400 Nov 23 08:52:57.514332 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 25/51] 10.222.0.46 () {60 vars in 1210 bytes} [Tue Nov 23 08:52:57 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 08:52:57.524028 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-ed6b4025-2f6a-4556-ae2a-8e6cab4ddca0 admin admin] Calling method '>' {{(pid=101849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:52:57.529083 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.wsgi [None req-ed6b4025-2f6a-4556-ae2a-8e6cab4ddca0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 23 08:52:57.529661 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-ed6b4025-2f6a-4556-ae2a-8e6cab4ddca0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 08:52:57.530422 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.requestlog [None req-ed6b4025-2f6a-4556-ae2a-8e6cab4ddca0 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009787 Nov 23 08:52:57.530907 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: [pid: 101849|app: 0|req: 27/52] 10.222.0.46 () {60 vars in 1193 bytes} [Tue Nov 23 08:52:57 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 23 08:52:58.916162 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-b271b5c0-a97e-4754-85f1-9423d6adf9ff admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:52:58.917203 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-b271b5c0-a97e-4754-85f1-9423d6adf9ff admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 Nov 23 08:52:58.917592 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 26/53] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Nov 23 08:52:58 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:52:59.109372 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-e0661402-d4c9-4715-a400-6820dc2eb653 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:52:59.127520 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.requestlog [None req-e0661402-d4c9-4715-a400-6820dc2eb653 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.070267 Nov 23 08:52:59.128009 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: [pid: 101849|app: 0|req: 28/54] 10.222.0.46 () {64 vars in 1235 bytes} [Tue Nov 23 08:52:59 2021] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 08:53:00.505626 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-b271b5c0-a97e-4754-85f1-9423d6adf9ff admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:53:00.506662 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-b271b5c0-a97e-4754-85f1-9423d6adf9ff admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Nov 23 08:53:00.507050 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 27/55] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Nov 23 08:53:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:53:00.698206 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-d24b6c67-ad05-45ba-9086-67291f174d69 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:53:00.714846 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.requestlog [None req-d24b6c67-ad05-45ba-9086-67291f174d69 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.067508 Nov 23 08:53:00.715398 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: [pid: 101849|app: 0|req: 29/56] 10.222.0.46 () {64 vars in 1235 bytes} [Tue Nov 23 08:53:00 2021] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 08:53:02.110813 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-b271b5c0-a97e-4754-85f1-9423d6adf9ff admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:53:02.111629 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-b271b5c0-a97e-4754-85f1-9423d6adf9ff admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Nov 23 08:53:02.111887 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 28/57] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Nov 23 08:53:02 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:53:02.305749 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-7764e766-b298-4440-980b-e7e49abd0d23 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:53:02.323746 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.requestlog [None req-7764e766-b298-4440-980b-e7e49abd0d23 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068729 Nov 23 08:53:02.324285 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: [pid: 101849|app: 0|req: 30/58] 10.222.0.46 () {64 vars in 1235 bytes} [Tue Nov 23 08:53:02 2021] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 08:53:03.731268 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-b271b5c0-a97e-4754-85f1-9423d6adf9ff admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:53:03.732255 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-b271b5c0-a97e-4754-85f1-9423d6adf9ff admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 Nov 23 08:53:03.732648 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 29/59] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Nov 23 08:53:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 08:53:03.923625 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-938917ed-cfcd-4899-9155-a4c0248da96d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:53:03.941189 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.requestlog [None req-938917ed-cfcd-4899-9155-a4c0248da96d admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069796 Nov 23 08:53:03.941664 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: [pid: 101849|app: 0|req: 31/60] 10.222.0.46 () {64 vars in 1235 bytes} [Tue Nov 23 08:53:03 2021] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 08:53:05.324207 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-b271b5c0-a97e-4754-85f1-9423d6adf9ff admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:53:05.325241 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-b271b5c0-a97e-4754-85f1-9423d6adf9ff admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Nov 23 08:53:05.325638 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 30/61] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Nov 23 08:53:05 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:53:05.516251 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-abce992e-abf1-4188-8bb6-fda9ee21625d admin admin] Calling method '>' {{(pid=101849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:53:05.535410 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.requestlog [None req-abce992e-abf1-4188-8bb6-fda9ee21625d admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070292 Nov 23 08:53:05.535944 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: [pid: 101849|app: 0|req: 32/62] 10.222.0.46 () {60 vars in 1202 bytes} [Tue Nov 23 08:53:05 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 08:53:51.431539 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-b271b5c0-a97e-4754-85f1-9423d6adf9ff admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:53:51.432528 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-b271b5c0-a97e-4754-85f1-9423d6adf9ff admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Nov 23 08:53:51.432926 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 31/63] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 23 08:53:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:53:51.490166 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-f1aea5d0-aeb6-4e0f-850e-41f2e5804143 admin admin] Calling method '>' {{(pid=101849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:53:51.508581 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.requestlog [None req-f1aea5d0-aeb6-4e0f-850e-41f2e5804143 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069195 Nov 23 08:53:51.509111 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: [pid: 101849|app: 0|req: 33/64] 10.222.0.46 () {60 vars in 1291 bytes} [Tue Nov 23 08:53:51 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 08:53:51.531095 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-25de5fb2-4e71-4c00-85f4-920e4cd223ae admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:53:51.539260 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-25de5fb2-4e71-4c00-85f4-920e4cd223ae admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011656 Nov 23 08:53:51.539776 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 32/65] 10.222.0.46 () {60 vars in 1282 bytes} [Tue Nov 23 08:53:51 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:53:51.551155 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-94d517d1-d4f6-4e54-aad2-25a226666b4f admin admin] Calling method '>' {{(pid=101849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:53:51.558628 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.requestlog [None req-94d517d1-d4f6-4e54-aad2-25a226666b4f admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010930 Nov 23 08:53:51.559137 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: [pid: 101849|app: 0|req: 34/66] 10.222.0.46 () {60 vars in 1285 bytes} [Tue Nov 23 08:53:51 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:53:51.570321 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-41845668-5c5a-4909-a77d-da06f5bfddcf admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:53:51.577945 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-41845668-5c5a-4909-a77d-da06f5bfddcf admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011039 Nov 23 08:53:51.578453 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 33/67] 10.222.0.46 () {60 vars in 1285 bytes} [Tue Nov 23 08:53:51 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:53:51.590178 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-809a9c47-8640-4f7d-97f7-67480db48af3 admin admin] Calling method '>' {{(pid=101849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:53:51.598518 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.requestlog [None req-809a9c47-8640-4f7d-97f7-67480db48af3 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011383 Nov 23 08:53:51.599026 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: [pid: 101849|app: 0|req: 35/68] 10.222.0.46 () {60 vars in 1282 bytes} [Tue Nov 23 08:53:51 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:55:13.219307 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-a1a9a48f-da4c-469d-a555-99cea35cc7f5 tempest-verify_tempest_config-1470303569 tempest-verify_tempest_config-1470303569-project] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:55:13.221286 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-a1a9a48f-da4c-469d-a555-99cea35cc7f5 tempest-verify_tempest_config-1470303569 tempest-verify_tempest_config-1470303569-project] 10.222.0.46 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.106395 Nov 23 08:55:13.221849 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 34/69] 10.222.0.46 () {58 vars in 1133 bytes} [Tue Nov 23 08:55:13 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 08:56:40.385679 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-809a9c47-8640-4f7d-97f7-67480db48af3 admin admin] Calling method '>' {{(pid=101849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:56:40.386686 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.requestlog [None req-809a9c47-8640-4f7d-97f7-67480db48af3 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Nov 23 08:56:40.387086 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: [pid: 101849|app: 0|req: 36/70] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Nov 23 08:56:40 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:56:40.656397 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-385f8a6e-9a4f-4752-a482-cd55a1f1960a admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:56:40.658194 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 08:56:40.658194 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: warnings.warn(msg) Nov 23 08:56:40.659722 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG oslo_concurrency.lockutils [None req-385f8a6e-9a4f-4752-a482-cd55a1f1960a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:56:40.660162 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG oslo_concurrency.lockutils [None req-385f8a6e-9a4f-4752-a482-cd55a1f1960a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:56:40.660967 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG oslo_concurrency.lockutils [None req-385f8a6e-9a4f-4752-a482-cd55a1f1960a admin admin] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:56:40.661397 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG oslo_concurrency.lockutils [None req-385f8a6e-9a4f-4752-a482-cd55a1f1960a admin admin] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:56:40.694386 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-385f8a6e-9a4f-4752-a482-cd55a1f1960a admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.153143 Nov 23 08:56:40.694942 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 35/71] 10.222.0.46 () {60 vars in 1193 bytes} [Tue Nov 23 08:56:40 2021] GET /compute/v2.1/os-services => generated 794 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 08:56:42.110018 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-809a9c47-8640-4f7d-97f7-67480db48af3 admin admin] Calling method '>' {{(pid=101849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:56:42.111231 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.requestlog [None req-809a9c47-8640-4f7d-97f7-67480db48af3 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001784 Nov 23 08:56:42.111659 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: [pid: 101849|app: 0|req: 37/72] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Nov 23 08:56:42 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:56:42.311712 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-471d2703-d873-44a9-bc8e-495be0c238bd admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:56:42.312951 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 08:56:42.312951 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: warnings.warn(msg) Nov 23 08:56:42.315137 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG oslo_concurrency.lockutils [None req-471d2703-d873-44a9-bc8e-495be0c238bd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:56:42.315603 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG oslo_concurrency.lockutils [None req-471d2703-d873-44a9-bc8e-495be0c238bd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:56:42.316429 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG oslo_concurrency.lockutils [None req-471d2703-d873-44a9-bc8e-495be0c238bd admin admin] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:56:42.316936 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG oslo_concurrency.lockutils [None req-471d2703-d873-44a9-bc8e-495be0c238bd admin admin] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:56:42.337493 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-471d2703-d873-44a9-bc8e-495be0c238bd admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.079117 Nov 23 08:56:42.338282 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 36/73] 10.222.0.46 () {60 vars in 1193 bytes} [Tue Nov 23 08:56:42 2021] GET /compute/v2.1/os-services => generated 794 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 08:56:54.183004 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-809a9c47-8640-4f7d-97f7-67480db48af3 admin admin] Calling method '>' {{(pid=101849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:56:54.184006 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.requestlog [None req-809a9c47-8640-4f7d-97f7-67480db48af3 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Nov 23 08:56:54.184393 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: [pid: 101849|app: 0|req: 38/74] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Nov 23 08:56:54 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:56:54.381526 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-799b2511-e00b-4e9c-9d8b-1283d6c17a5c admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:56:54.382966 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 08:56:54.382966 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: warnings.warn(msg) Nov 23 08:56:54.384498 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG oslo_concurrency.lockutils [None req-799b2511-e00b-4e9c-9d8b-1283d6c17a5c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:56:54.384931 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG oslo_concurrency.lockutils [None req-799b2511-e00b-4e9c-9d8b-1283d6c17a5c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:56:54.385777 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG oslo_concurrency.lockutils [None req-799b2511-e00b-4e9c-9d8b-1283d6c17a5c admin admin] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:56:54.386207 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG oslo_concurrency.lockutils [None req-799b2511-e00b-4e9c-9d8b-1283d6c17a5c admin admin] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:56:54.411421 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-799b2511-e00b-4e9c-9d8b-1283d6c17a5c admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.086287 Nov 23 08:56:54.411983 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 37/75] 10.222.0.46 () {60 vars in 1193 bytes} [Tue Nov 23 08:56:54 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 08:56:55.796744 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: DEBUG nova.api.openstack.wsgi [None req-809a9c47-8640-4f7d-97f7-67480db48af3 admin admin] Calling method '>' {{(pid=101849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:56:55.797782 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: INFO nova.api.openstack.requestlog [None req-809a9c47-8640-4f7d-97f7-67480db48af3 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Nov 23 08:56:55.798846 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: [pid: 101849|app: 0|req: 39/76] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Nov 23 08:56:55 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:56:55.991356 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-0b85f228-3684-433f-953d-87222c8894e6 admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:56:55.992511 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 08:56:55.992511 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: warnings.warn(msg) Nov 23 08:56:55.994099 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG oslo_concurrency.lockutils [None req-0b85f228-3684-433f-953d-87222c8894e6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:56:55.994542 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG oslo_concurrency.lockutils [None req-0b85f228-3684-433f-953d-87222c8894e6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:56:55.995342 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG oslo_concurrency.lockutils [None req-0b85f228-3684-433f-953d-87222c8894e6 admin admin] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:56:55.995774 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: DEBUG oslo_concurrency.lockutils [None req-0b85f228-3684-433f-953d-87222c8894e6 admin admin] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:56:56.016871 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-0b85f228-3684-433f-953d-87222c8894e6 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.077491 Nov 23 08:56:56.017395 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 38/77] 10.222.0.46 () {60 vars in 1193 bytes} [Tue Nov 23 08:56:55 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 08:57:52.887446 dv-cinder-768458-17-iscsi devstack@n-api.service[101848]: Tue Nov 23 08:57:52 2021 - graceful shutdown triggered... Nov 23 08:57:52.887975 dv-cinder-768458-17-iscsi devstack@n-api.service[101849]: Gracefully killing worker 1 (pid: 101849)... Nov 23 08:57:52.887559 dv-cinder-768458-17-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 23 08:57:52.888789 dv-cinder-768458-17-iscsi devstack@n-api.service[101850]: Gracefully killing worker 2 (pid: 101850)... Nov 23 08:57:53.888579 dv-cinder-768458-17-iscsi devstack@n-api.service[101848]: worker 1 buried after 1 seconds Nov 23 08:57:53.889023 dv-cinder-768458-17-iscsi devstack@n-api.service[101848]: worker 2 buried after 1 seconds Nov 23 08:57:53.889023 dv-cinder-768458-17-iscsi devstack@n-api.service[101848]: goodbye to uWSGI. Nov 23 08:57:53.890143 dv-cinder-768458-17-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 23 08:57:53.890723 dv-cinder-768458-17-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 23 08:57:53.893519 dv-cinder-768458-17-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 23 08:57:53.903304 dv-cinder-768458-17-iscsi devstack@n-api.service[116217]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 23 08:57:53.905245 dv-cinder-768458-17-iscsi devstack@n-api.service[116217]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Nov 23 08:57:53 2021] *** Nov 23 08:57:53.905245 dv-cinder-768458-17-iscsi devstack@n-api.service[116217]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 23 08:57:53.905245 dv-cinder-768458-17-iscsi devstack@n-api.service[116217]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 23 08:57:53.905245 dv-cinder-768458-17-iscsi devstack@n-api.service[116217]: nodename: dv-cinder-768458-17-iscsi Nov 23 08:57:53.905245 dv-cinder-768458-17-iscsi devstack@n-api.service[116217]: machine: x86_64 Nov 23 08:57:53.905245 dv-cinder-768458-17-iscsi devstack@n-api.service[116217]: clock source: unix Nov 23 08:57:53.905245 dv-cinder-768458-17-iscsi devstack@n-api.service[116217]: pcre jit disabled Nov 23 08:57:53.905245 dv-cinder-768458-17-iscsi devstack@n-api.service[116217]: detected number of CPU cores: 4 Nov 23 08:57:53.905245 dv-cinder-768458-17-iscsi devstack@n-api.service[116217]: current working directory: / Nov 23 08:57:53.905245 dv-cinder-768458-17-iscsi devstack@n-api.service[116217]: detected binary path: /usr/bin/uwsgi-core Nov 23 08:57:53.905245 dv-cinder-768458-17-iscsi devstack@n-api.service[116217]: your processes number limit is 47680 Nov 23 08:57:53.905245 dv-cinder-768458-17-iscsi devstack@n-api.service[116217]: your memory page size is 4096 bytes Nov 23 08:57:53.905245 dv-cinder-768458-17-iscsi devstack@n-api.service[116217]: detected max file descriptor number: 2048 Nov 23 08:57:53.906078 dv-cinder-768458-17-iscsi devstack@n-api.service[116217]: lock engine: pthread robust mutexes Nov 23 08:57:53.906078 dv-cinder-768458-17-iscsi devstack@n-api.service[116217]: thunder lock: enabled Nov 23 08:57:53.906078 dv-cinder-768458-17-iscsi devstack@n-api.service[116217]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 23 08:57:53.906078 dv-cinder-768458-17-iscsi devstack@n-api.service[116217]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 23 08:57:53.950816 dv-cinder-768458-17-iscsi devstack@n-api.service[116217]: Python main interpreter initialized at 0x55957739a9c0 Nov 23 08:57:53.950816 dv-cinder-768458-17-iscsi devstack@n-api.service[116217]: python threads support enabled Nov 23 08:57:53.950816 dv-cinder-768458-17-iscsi devstack@n-api.service[116217]: your server socket listen backlog is limited to 100 connections Nov 23 08:57:53.950816 dv-cinder-768458-17-iscsi devstack@n-api.service[116217]: your mercy for graceful operations on workers is 90 seconds Nov 23 08:57:53.951245 dv-cinder-768458-17-iscsi devstack@n-api.service[116217]: mapped 403077 bytes (393 KB) for 2 cores Nov 23 08:57:53.951245 dv-cinder-768458-17-iscsi devstack@n-api.service[116217]: *** Operational MODE: preforking *** Nov 23 08:57:53.951516 dv-cinder-768458-17-iscsi devstack@n-api.service[116217]: *** uWSGI is running in multiple interpreter mode *** Nov 23 08:57:53.951516 dv-cinder-768458-17-iscsi devstack@n-api.service[116217]: spawned uWSGI master process (pid: 116217) Nov 23 08:57:53.951730 dv-cinder-768458-17-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 23 08:57:53.952861 dv-cinder-768458-17-iscsi devstack@n-api.service[116217]: spawned uWSGI worker 1 (pid: 116226, cores: 1) Nov 23 08:57:53.952861 dv-cinder-768458-17-iscsi devstack@n-api.service[116217]: spawned uWSGI worker 2 (pid: 116227, cores: 1) Nov 23 08:57:53.952861 dv-cinder-768458-17-iscsi devstack@n-api.service[116217]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 23 08:57:55.731970 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 08:57:55.731970 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: from cryptography.utils import int_from_bytes Nov 23 08:57:55.732670 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 08:57:55.732670 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: from cryptography.utils import int_from_bytes Nov 23 08:57:55.734320 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 08:57:55.734320 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: from cryptography.utils import int_from_bytes Nov 23 08:57:55.734796 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 08:57:55.734796 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: from cryptography.utils import int_from_bytes Nov 23 08:57:58.107792 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 23 08:57:58.108437 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 23 08:57:58.108545 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 23 08:57:58.108911 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 23 08:57:58.109034 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 23 08:57:58.109517 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 23 08:57:58.109623 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 23 08:57:58.109715 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.109799 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 23 08:57:58.109885 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.110112 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 23 08:57:58.110229 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.110384 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 23 08:57:58.110544 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.110726 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.110898 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.111059 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.111166 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.111381 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.111490 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.111722 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.111815 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.112046 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.112152 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.113191 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.113323 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.113323 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.113486 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.113593 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-768458-17-iscsi {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.113724 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.114093 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.114194 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.114280 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.114365 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.114536 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.114688 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.114832 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.114982 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-768458-17-iscsi {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.115138 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.115291 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.115444 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.115589 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.115742 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.115948 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.116160 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.116320 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.116493 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.116785 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.117100 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.117662 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.117931 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.118147 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.118373 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.118579 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.118800 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.119020 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.119237 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.119452 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.119667 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.119889 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.120108 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.120321 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.120535 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.120740 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.120958 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.121197 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.121444 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.121648 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.121866 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.122082 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.122303 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-768458-17-iscsi {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.122525 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-768458-17-iscsi {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.122731 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.122909 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.123119 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.123275 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.123457 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.123620 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.123804 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.123953 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.124103 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.124261 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.124417 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.124597 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.124751 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.124980 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.124980 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.125351 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.125504 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.125649 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.125811 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.125984 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.126144 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.126294 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.126437 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.126580 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.126580 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.126858 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.127010 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.127237 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.128166 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.128343 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.128590 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.128765 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.128922 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.129067 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.129243 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.129391 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.129542 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.129694 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.129694 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.130053 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.130201 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.130351 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.130494 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.130660 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.130803 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.130946 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.131124 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.131275 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.131429 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.131626 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.131784 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.131946 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.132090 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.132287 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.132441 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.132593 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.132743 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.132893 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.133044 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.133246 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.133405 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.133557 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.133700 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.133848 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.134094 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.134262 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.134418 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.134566 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.134716 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.134865 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.135014 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.135169 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.135312 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.135462 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.135604 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.135747 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.135896 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.136056 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.136206 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.136368 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.136521 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.136665 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.136815 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.136972 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.137115 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.137292 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.137464 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.138119 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.138478 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.138632 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.138776 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.138938 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.139088 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.139231 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.139382 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.139532 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.139687 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.140444 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.140619 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.140773 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.140930 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.141074 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.141287 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.141435 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.141591 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.141742 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.141901 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.142053 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.142196 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.142349 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.142491 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.142644 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.142796 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.142940 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.143081 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.143225 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.143367 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.143529 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.143733 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.143898 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.144187 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.144378 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.144729 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.145100 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.145273 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.145418 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.145561 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.145714 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.145858 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.146011 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.146175 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.146320 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.146476 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.146628 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.146784 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.146936 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.147079 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.147222 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.147372 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.147516 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.147668 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.148655 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.148806 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.148960 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.149118 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.149318 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.149611 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.149611 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.149902 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.150053 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.150205 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.150356 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.150499 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.150641 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.150785 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.150946 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.151089 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.151247 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.151399 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.151548 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.151699 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.151849 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.151992 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.152151 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.152296 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.152444 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.152587 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.152736 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.152890 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.153049 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.153212 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.153372 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.153523 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.153666 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.153815 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.153967 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.154126 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.154366 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.154508 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.154659 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.154812 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.154964 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.155113 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.155267 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.155416 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.155566 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.155724 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.155867 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.156015 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.156165 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.156309 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.156460 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.156610 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.156761 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.156913 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.157056 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.157226 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.157388 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.157541 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.157690 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.157995 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.158742 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.158903 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.159061 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.159741 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.159902 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.160046 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.160212 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.160411 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.160596 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.160749 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.160893 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.161036 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 08:57:58.161227 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.161390 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.161534 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.161685 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.161830 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.161980 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.162141 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.162299 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.162451 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.162611 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.162763 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.162907 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.163049 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.163203 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.163347 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.163495 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.163638 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.163782 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.163942 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.164086 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.164239 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.164476 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.164627 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.164778 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.164934 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.165089 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.165253 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.165399 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.165541 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.165683 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.165843 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.166079 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.166232 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.166376 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.166518 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.166668 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.166823 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.166976 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.167119 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.167269 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.167417 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.167560 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.167708 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.167862 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.168191 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.168613 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.168951 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.169108 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.169343 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.169504 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.169648 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.169798 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.169949 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.170093 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.170248 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.170408 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.170562 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.170705 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.170856 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.170990 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.171089 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.171229 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.171360 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.171495 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.171630 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.171765 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.171906 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.172042 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.172171 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.172306 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.172434 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.172565 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.172702 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.172839 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.172967 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.173103 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.173249 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.173395 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.173531 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.173667 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.173803 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.173938 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.174066 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.174207 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.174336 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.174544 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.174683 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.174825 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.175512 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.175663 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.175848 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.175992 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.176127 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.176127 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.176464 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.176627 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.176757 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.176885 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.177012 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.177139 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.177376 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.177376 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.177637 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.177637 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.177637 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.177637 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.177637 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.177637 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.178821 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.179154 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.179154 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.179399 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.179538 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.179538 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.179797 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.179925 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.180052 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.180179 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.180179 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.180438 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.180568 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.180568 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.180821 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.180957 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.181092 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.181265 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.181265 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.181524 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.181653 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.181653 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.181908 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.182043 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.182179 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.182312 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.182312 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.182664 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.182803 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.182938 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.183066 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.183202 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.183329 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.183329 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.183591 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.183720 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.183720 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.183966 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.184108 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.184108 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.184364 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.184492 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.184492 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.184816 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.184958 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.184958 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.185232 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.185368 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.185503 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.185631 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.185631 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.185889 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.186017 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.186017 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.186256 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.186390 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.186390 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.186648 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.186777 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.186912 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.187039 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.187039 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.187289 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.187415 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.187415 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.187664 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.187799 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.187937 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.188065 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.188065 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.188456 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.188997 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.188997 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.189508 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.189639 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.189639 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.189878 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.190006 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.190133 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.190278 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.190414 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.190577 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.190714 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.190849 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.190849 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.191184 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.191385 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.191554 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.191793 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.191793 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.192078 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.192209 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.192336 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.192463 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.192463 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.192722 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.192911 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.192911 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.193177 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.193317 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.193446 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.193580 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.193580 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.193913 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.194080 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.194080 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.194337 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.194478 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.194749 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.194888 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.195015 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.195220 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.195369 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.195627 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.195770 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.195949 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.196181 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.196315 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.196611 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.196754 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.196928 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.197116 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.197282 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.197580 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.197712 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.197921 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.198090 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.198222 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.198523 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.198957 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.199106 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.199249 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.199581 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.199722 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.199853 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.199988 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.200126 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.200260 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.200395 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.200619 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.200749 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.200941 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.201138 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.201296 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.201597 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.201805 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.201936 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.202098 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.202241 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.202530 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.202661 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.202851 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.203026 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.203165 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.203486 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.203620 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.203802 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.204011 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.204142 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.204430 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.204560 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.204727 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.204957 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.205091 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.205360 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.205550 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.205785 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.206000 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.206637 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.206945 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.207085 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.207388 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.207526 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.207754 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.208048 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.208179 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.208391 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.208678 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.209096 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.209264 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.209394 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.209394 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.209765 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.209979 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.210118 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.210254 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.210390 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.210524 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.210660 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.210862 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.210996 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.211239 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.211370 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.211561 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.211805 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.211945 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.212195 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.212334 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.212518 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.212725 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.212869 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.213136 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.213285 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.213481 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.213702 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.213842 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.214168 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.214395 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.214612 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.214743 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.215049 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.215199 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.215375 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.215545 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.215705 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.215988 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.216131 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.216359 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.216499 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.216696 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.216954 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.217090 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.217370 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.217511 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.217696 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.217857 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.218012 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.218299 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.218445 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.218629 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.218890 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.219280 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.219413 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.219539 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.219539 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.219890 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.220698 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.220835 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.221258 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.221391 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.221533 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.221662 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.221846 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.221846 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.222595 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.222733 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.223001 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.223144 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.223144 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.223445 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.223572 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.223739 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.224034 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.224200 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.224448 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.225697 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.225842 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.225980 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.226108 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.226251 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.226380 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.226380 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.226622 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.226749 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.226749 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.227015 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.227144 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.227273 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.227408 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.227408 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.227668 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.227802 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.227931 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.228056 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.228183 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.228439 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.228663 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.228970 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.229118 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.229633 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.229765 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.229910 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.230198 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.230328 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.230328 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.230566 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.230714 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.230714 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.231082 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.231219 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.231349 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.231484 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.231484 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.231772 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.231903 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.232122 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.232253 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.232434 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.232630 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.232775 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.233049 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.233203 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.233411 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.233580 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.233732 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.234041 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.234174 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.234351 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.234538 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.234677 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.234976 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.235114 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.235326 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.235456 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.235583 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.235888 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.236032 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.236387 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.236537 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.236675 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.236825 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.236957 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.237143 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.237385 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.237559 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.237876 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.238017 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.238182 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.238442 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.238582 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.238781 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.239020 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.239132 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.239420 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.239553 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.239745 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.239854 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.240057 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.240377 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.240483 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.240695 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.240794 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.241010 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.241216 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.241368 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.241519 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.241664 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.241803 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.241952 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.242097 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.242240 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.242391 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.242529 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.242675 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.242843 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.242984 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.243140 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.243284 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.243468 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.243612 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.243789 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.243929 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.244102 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.244250 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.244415 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.244556 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.244727 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.244867 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.245080 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.245318 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.245471 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.245606 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.245747 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.245885 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.246036 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.246181 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.246318 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.246456 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.246642 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.246793 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.246960 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.247107 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.247290 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.247439 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.247604 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.247744 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.247913 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.248051 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.248223 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.248373 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.248541 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.248681 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.248939 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.249101 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.249269 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.249376 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.249478 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.249856 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.249856 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.250033 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.250128 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.250213 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.250410 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.250502 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.250738 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.250830 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.251067 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.251166 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.251399 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.251494 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.251712 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.251811 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.252023 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.252114 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.252337 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.252435 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.252655 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.252755 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.252986 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.253087 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.253341 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.253433 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.253660 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.253764 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.253980 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.254071 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.254296 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.254387 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.254617 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.254716 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.254937 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.255029 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.255255 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.255354 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.255573 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.255673 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.255886 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.255984 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.256195 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.256293 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.256506 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.256603 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.256829 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.256920 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.257138 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.257295 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.257475 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.257576 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.257786 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.257876 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.258100 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.258190 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.258418 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.258555 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.258726 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.258863 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.259042 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.259185 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.259395 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.259508 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.259662 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.259924 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.260031 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.260126 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.260272 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.260442 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.260578 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.260767 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.260887 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.261088 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.261225 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.261428 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.261521 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.261853 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.261945 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.262174 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.262274 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.262494 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.262630 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.262815 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.262944 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.263212 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.263520 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.263917 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.264235 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.264560 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.264897 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.265239 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.265512 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.265650 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.265862 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.266050 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.266226 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.266333 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.266508 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.266658 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.266826 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.266994 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.267255 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.267366 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.267576 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.267685 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.267889 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.267987 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.268275 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.268372 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.269145 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.269288 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.269505 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.269613 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.269865 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.270182 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.270288 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.270472 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.270575 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.270797 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.270940 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.271121 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.271230 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.271429 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.271532 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.271762 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.271870 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.272078 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.272257 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.272393 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.272495 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.272708 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.272802 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.273017 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.273119 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.273374 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.273491 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.273704 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.273799 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.274025 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.274127 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.274357 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.274457 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.274689 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.274792 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.275011 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.275113 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.275335 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.275443 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.275658 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.275760 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.275971 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.276064 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.276294 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.276397 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.276613 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.276726 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.276929 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.277026 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.277263 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.277376 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.277577 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.277680 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.277903 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.277997 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.278215 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.278315 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.278528 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.278627 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.278845 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.278937 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.279164 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.279265 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.279477 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.279578 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.279787 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.279891 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.280146 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.280292 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.280419 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.280544 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.280747 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.280859 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.281066 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.281231 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.281406 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.281535 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.281735 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.281846 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.282051 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.282152 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.282384 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.282485 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.282702 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.282872 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.283018 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.283111 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.283333 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.283434 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.283648 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.283751 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.283964 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.284055 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.284330 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.284430 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.284741 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.284844 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.285081 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.285202 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.285426 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.285530 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.285744 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.285847 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.286057 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.286150 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.286374 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.286478 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.286686 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.286780 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.287020 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.287112 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.287352 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.287445 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.287665 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.287766 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.287977 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.288070 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.288293 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.288404 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.288607 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.288710 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.288921 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.289058 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.289255 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.289433 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.289575 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.289747 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.289889 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.290245 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.290405 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.290497 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.290582 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.290790 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.290885 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.291104 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.291205 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.291424 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.291571 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.291736 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.291832 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.292044 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.292147 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.292355 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.292449 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.292666 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.292761 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.292972 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.293073 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.293305 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.293413 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.293633 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.293736 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.293943 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.294038 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.294269 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.294362 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.294621 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.294756 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.294941 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.295052 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.295271 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.295370 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.295597 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.295770 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.295922 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.296074 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.296246 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.296389 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.296567 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.296716 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.296891 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.297043 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.297240 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.297392 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.297566 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.297679 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.297884 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.298132 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.298255 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.298379 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.298504 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.298689 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.298821 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.299018 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.299337 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.299458 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.299656 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.299787 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.300548 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.300674 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.300995 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.301118 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.301351 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.301475 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.301673 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.301807 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.301999 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.302121 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.302322 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.303456 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.303456 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.303724 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.303868 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.303972 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.304061 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.304154 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.304243 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.304327 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.304421 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.304516 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.304613 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.304700 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.304786 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.304870 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.304962 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.305058 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.305226 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.305414 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.305563 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.305742 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.305875 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.306063 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.306193 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.306427 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.306527 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.306756 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.306923 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.307067 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.307207 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.307388 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.307487 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.307709 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.307893 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.308001 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.308088 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.308326 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.308429 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.308643 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.308745 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.308950 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.309049 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.309296 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.309394 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.309613 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.309710 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.309928 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.310022 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.310240 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.310337 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.310558 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.310688 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.310871 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.310981 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.311180 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.311295 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.311525 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.311640 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.311832 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.311942 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.312154 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.312265 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.312477 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.312578 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.312806 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.313008 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.313110 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.313497 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.313616 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.313706 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.313792 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.314021 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.314168 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.314357 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.314454 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.314681 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.314776 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.315002 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.315105 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.315315 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.315418 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.315739 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.315836 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.316054 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.316158 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.316363 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.316464 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.316670 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.316763 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.316980 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.317083 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.317311 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.317407 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.317619 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.317723 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.317924 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.318033 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.318248 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.318349 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.318555 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.318649 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.318880 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.319138 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.319242 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.319485 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.319586 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.319793 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.319905 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.320100 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.320203 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.320439 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.320532 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.320744 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.320914 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.321064 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.321216 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.321419 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.321547 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.321734 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.321838 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.322051 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.322147 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.322375 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.322477 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.322694 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.322797 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.323007 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.323110 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.323320 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.323423 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.323632 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.323728 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.323941 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.324056 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.324253 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.324351 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.324570 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.324673 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.324883 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.324977 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.325232 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.325346 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.325550 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.325653 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.325864 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.325969 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.326177 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.326286 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.326499 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.326725 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.326828 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.327056 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.327162 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.327374 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.327531 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.327691 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.327796 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.328006 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.328101 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.328313 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.328408 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.328627 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.328720 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.328936 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.329042 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.329269 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.329377 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.329580 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.329673 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.329889 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.329992 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.330195 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.330288 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.330523 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.330624 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.330839 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.331660 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.331859 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.331985 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.332213 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.332430 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.332571 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.332764 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.332917 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.333087 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.333261 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.333437 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.333588 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.333795 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.333996 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.334103 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.334267 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.334583 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.334676 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.334903 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.335025 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.335303 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.335399 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.335543 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.335698 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.335860 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.336045 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.336178 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.336362 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.336498 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.336679 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.336816 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.336992 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.337131 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.337349 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.337466 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.337667 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.337782 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.337985 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.338100 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.338304 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.338428 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.338621 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.338783 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.338938 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.339089 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.339253 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.339461 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.339545 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.339787 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.339902 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.340131 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.340240 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.340461 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.340729 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.340836 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.341054 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.341232 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.341415 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.341527 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.341745 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.341848 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.342069 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.342177 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.342384 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.342488 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.342699 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.342792 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.343014 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.343123 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.343321 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.343414 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.343642 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.343735 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.343978 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.344104 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.344289 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.344395 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.344594 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.344738 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.344918 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.345015 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.345261 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.345411 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.345637 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.345765 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.346176 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.346274 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.346491 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.346599 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.347644 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.347751 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.348015 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.348157 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.348339 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.348484 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.348669 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.348775 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.348991 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.349077 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.349358 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.349458 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.349672 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.349785 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.350034 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.350128 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.350365 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.350459 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.350679 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.350783 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.351007 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.351149 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.351687 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.351810 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.351916 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.352044 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.352224 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.352330 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.352420 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.352506 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.352602 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.352702 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.352920 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.353041 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.353253 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.353360 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.353527 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.353632 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.353853 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.353955 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.354162 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.354263 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.354474 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.354583 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.354784 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.354896 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.355101 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.355204 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.355416 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.355519 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.355726 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.355840 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.356035 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.356147 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.356343 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.356453 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.356657 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.356766 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.356962 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.357072 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.357295 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.357398 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.357605 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.357717 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.357920 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.358032 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.358228 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.358338 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.358553 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.358664 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.358866 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.359103 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.359458 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.359609 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.359609 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.359896 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.360045 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.360193 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.360430 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.360574 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.360730 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.360879 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.361039 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.361207 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.361347 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.361497 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.361638 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.361787 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.361943 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.362091 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.362239 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.362410 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.362410 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.362781 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.363062 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.363455 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.363616 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.363770 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.363923 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.364079 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.364234 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.364375 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.364471 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.364612 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.364763 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.364915 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.365063 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.365297 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.365444 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.365586 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.365734 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.365909 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.366059 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.366205 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.366350 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 23 08:57:58.366504 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.366504 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.366790 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.366933 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.367159 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.367473 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.367785 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.368103 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.368443 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.368763 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.369140 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.369548 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.369769 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.370084 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.370397 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.370709 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.371021 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.371340 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.371673 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.371990 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.372300 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.372727 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.373045 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.373400 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.373715 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.374032 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.374356 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.374713 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.374997 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.375319 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.376129 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.376129 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.376442 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.376597 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.376959 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.377292 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.377608 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.377917 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.378367 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.378676 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.379013 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.379335 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.379746 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.379958 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.380282 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.380594 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.380919 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.381266 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.381585 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.382079 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.382260 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.382565 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.382882 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.383541 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.383541 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.383863 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.384104 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.384596 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.384773 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.385057 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.385434 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.385756 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.386082 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.386402 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.386718 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.387050 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.387366 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.387687 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.388001 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.388315 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.388477 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_db.sqlalchemy.engines [None req-949a021e-f8e5-44b5-aa90-932d58163d4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116227) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 08:57:58.388641 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.388966 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.389417 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.389665 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.390034 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.390293 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.390644 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.390965 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.391315 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.391645 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.391965 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.392285 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.392595 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 08:57:58.392841 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 23 08:57:58.417368 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_db.sqlalchemy.engines [None req-799d3d97-da8e-481b-a038-fd2abf71b002 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116226) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 08:57:58.548470 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.context [None req-949a021e-f8e5-44b5-aa90-932d58163d4d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),848a0ecb-e389-4eb0-b537-075130526b9c(cell1) {{(pid=116227) load_cells /opt/stack/nova/nova/context.py:464}} Nov 23 08:57:58.552998 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-949a021e-f8e5-44b5-aa90-932d58163d4d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:57:58.554616 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-949a021e-f8e5-44b5-aa90-932d58163d4d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:57:58.555431 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-949a021e-f8e5-44b5-aa90-932d58163d4d None None] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:57:58.557448 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-949a021e-f8e5-44b5-aa90-932d58163d4d None None] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:57:58.571070 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_db.sqlalchemy.engines [None req-949a021e-f8e5-44b5-aa90-932d58163d4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116227) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 08:57:58.571279 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_db.sqlalchemy.engines [None req-949a021e-f8e5-44b5-aa90-932d58163d4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116227) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 08:57:58.579873 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.context [None req-799d3d97-da8e-481b-a038-fd2abf71b002 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),848a0ecb-e389-4eb0-b537-075130526b9c(cell1) {{(pid=116226) load_cells /opt/stack/nova/nova/context.py:464}} Nov 23 08:57:58.585075 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-799d3d97-da8e-481b-a038-fd2abf71b002 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:57:58.587294 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-799d3d97-da8e-481b-a038-fd2abf71b002 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:57:58.588128 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-799d3d97-da8e-481b-a038-fd2abf71b002 None None] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:57:58.590167 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-799d3d97-da8e-481b-a038-fd2abf71b002 None None] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:57:58.601595 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_db.sqlalchemy.engines [None req-799d3d97-da8e-481b-a038-fd2abf71b002 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116226) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 08:57:58.603145 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_db.sqlalchemy.engines [None req-799d3d97-da8e-481b-a038-fd2abf71b002 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116226) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 08:57:58.736779 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_db.sqlalchemy.engines [None req-949a021e-f8e5-44b5-aa90-932d58163d4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116227) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 08:57:58.767113 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_db.sqlalchemy.engines [None req-799d3d97-da8e-481b-a038-fd2abf71b002 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116226) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 08:57:59.064165 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: WARNING keystonemiddleware.auth_token [None req-949a021e-f8e5-44b5-aa90-932d58163d4d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 08:57:59.071520 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: WARNING keystonemiddleware.auth_token [None req-949a021e-f8e5-44b5-aa90-932d58163d4d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 08:57:59.092533 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: WARNING keystonemiddleware.auth_token [None req-799d3d97-da8e-481b-a038-fd2abf71b002 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 08:57:59.099348 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: WARNING keystonemiddleware.auth_token [None req-799d3d97-da8e-481b-a038-fd2abf71b002 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 08:57:59.416804 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: WARNING keystonemiddleware.auth_token [None req-949a021e-f8e5-44b5-aa90-932d58163d4d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 08:57:59.422280 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: WARNING keystonemiddleware.auth_token [None req-949a021e-f8e5-44b5-aa90-932d58163d4d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 08:57:59.428262 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55957739a9c0 pid: 116227 (default app) Nov 23 08:57:59.450078 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: WARNING keystonemiddleware.auth_token [None req-799d3d97-da8e-481b-a038-fd2abf71b002 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 08:57:59.455263 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: WARNING keystonemiddleware.auth_token [None req-799d3d97-da8e-481b-a038-fd2abf71b002 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 08:57:59.461115 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55957739a9c0 pid: 116226 (default app) Nov 23 08:58:34.185140 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-446b585b-5f6c-4fb9-938b-70c9a42ba55e tempest-VolumesGetTestJSON-636234082 tempest-VolumesGetTestJSON-636234082-project] Action: 'create', calling method: .version_select at 0x7f527c2131f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1089124317", "metadata": {"Type": "work"}}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:58:34.509740 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-47671a49-c366-4200-a981-8033ac2b7600 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2094892159", "imageRef": "18424a16-ac32-42d5-8161-d6cb36423de3", "flavorRef": "452", "networks": [{"uuid": "d97b32ee-221e-4103-8904-28844344b922"}]}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:58:35.193688 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.network.neutron [None req-47671a49-c366-4200-a981-8033ac2b7600 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] validate_networks() for [('d97b32ee-221e-4103-8904-28844344b922', None, None, None, None, None)] {{(pid=116226) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 08:58:35.524107 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-446b585b-5f6c-4fb9-938b-70c9a42ba55e tempest-VolumesGetTestJSON-636234082 tempest-VolumesGetTestJSON-636234082-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.666101 Nov 23 08:58:35.525821 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 1/1] 10.222.0.46 () {60 vars in 1155 bytes} [Tue Nov 23 08:58:32 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 2670 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 23 08:58:35.744044 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-a090db7e-660b-4512-9f21-1b5949159346 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1040211814", "imageRef": "18424a16-ac32-42d5-8161-d6cb36423de3", "flavorRef": "452", "networks": [{"uuid": "90165a93-ecd4-4624-b7b5-1b5c85ea25bb"}]}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:58:36.076079 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.network.neutron [None req-a090db7e-660b-4512-9f21-1b5949159346 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] validate_networks() for [('90165a93-ecd4-4624-b7b5-1b5c85ea25bb', None, None, None, None, None)] {{(pid=116227) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 08:58:36.669000 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-47671a49-c366-4200-a981-8033ac2b7600 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Flavor limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 08:58:36.669000 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-47671a49-c366-4200-a981-8033ac2b7600 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Image limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 08:58:36.669000 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-47671a49-c366-4200-a981-8033ac2b7600 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Flavor pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 08:58:36.669000 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-47671a49-c366-4200-a981-8033ac2b7600 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Image pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 08:58:36.669000 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-47671a49-c366-4200-a981-8033ac2b7600 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 08:58:36.681365 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-47671a49-c366-4200-a981-8033ac2b7600 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:36.681365 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-47671a49-c366-4200-a981-8033ac2b7600 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:36.681365 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-47671a49-c366-4200-a981-8033ac2b7600 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:36.681365 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-47671a49-c366-4200-a981-8033ac2b7600 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:36.697256 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-47671a49-c366-4200-a981-8033ac2b7600 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Getting quotas for project 4ccfb93758054da3a7ba7a802b01ca8d. Resources: {'instances', 'ram', 'cores'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 08:58:36.712131 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-47671a49-c366-4200-a981-8033ac2b7600 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Getting quotas for user 460e9ced9648454dabe601930a8321e1 and project 4ccfb93758054da3a7ba7a802b01ca8d. Resources: {'instances', 'ram', 'cores'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 08:58:36.729853 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-47671a49-c366-4200-a981-8033ac2b7600 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Going to run 1 instances... {{(pid=116226) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 08:58:36.733536 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-47671a49-c366-4200-a981-8033ac2b7600 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='18424a16-ac32-42d5-8161-d6cb36423de3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116226) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 08:58:36.857285 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-47671a49-c366-4200-a981-8033ac2b7600 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.502024 Nov 23 08:58:36.858634 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 1/2] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 23 08:58:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 3505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 08:58:36.865721 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-003aea55-bd9a-457e-9746-593567627d49 tempest-VolumesGetTestJSON-636234082 tempest-VolumesGetTestJSON-636234082-project] Calling method '.version_select at 0x7f527b801b80>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:36.946395 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-003aea55-bd9a-457e-9746-593567627d49 tempest-VolumesGetTestJSON-636234082 tempest-VolumesGetTestJSON-636234082-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/432c2861-25bd-41ae-a057-0561d3a3fb18" status: 200 len: 354 microversion: 2.1 time: 0.085992 Nov 23 08:58:36.947055 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 2/3] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 23 08:58:36 2021] GET /compute/v2.1/os-volumes/432c2861-25bd-41ae-a057-0561d3a3fb18 => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:58:36.952132 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d514cc54-a7ae-42c7-9402-7e4cbfb41c38 tempest-VolumesTestJSON-331917586 tempest-VolumesTestJSON-331917586-project] Calling method '.version_select at 0x7f527b801c10>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:37.044754 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d514cc54-a7ae-42c7-9402-7e4cbfb41c38 tempest-VolumesTestJSON-331917586 tempest-VolumesTestJSON-331917586-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/459dcd83-8cab-446b-bf17-354465d9f01c" status: 200 len: 350 microversion: 2.1 time: 0.096226 Nov 23 08:58:37.045715 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 3/4] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 23 08:58:36 2021] GET /compute/v2.1/os-volumes/459dcd83-8cab-446b-bf17-354465d9f01c => generated 350 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:58:37.052939 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-ed1672a0-704d-4a79-a115-d311b962f933 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:37.054723 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-ed1672a0-704d-4a79-a115-d311b962f933 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:58:37.406263 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-ed1672a0-704d-4a79-a115-d311b962f933 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460e9ced9648454dabe601930a8321e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ccfb93758054da3a7ba7a802b01ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:58:37.437134 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-ed1672a0-704d-4a79-a115-d311b962f933 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39" status: 200 len: 1215 microversion: 2.1 time: 0.388296 Nov 23 08:58:37.438185 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 4/5] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:58:37 2021] GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39 => generated 1215 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:58:37.449824 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-66c4f31f-d028-49dc-940e-81284dca149b tempest-VolumesGetTestJSON-636234082 tempest-VolumesGetTestJSON-636234082-project] Calling method '.version_select at 0x7f527af9f160>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:37.523806 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.virt.hardware [None req-a090db7e-660b-4512-9f21-1b5949159346 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Flavor limits 0:0:0 {{(pid=116227) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 08:58:37.524296 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.virt.hardware [None req-a090db7e-660b-4512-9f21-1b5949159346 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Image limits 0:0:0 {{(pid=116227) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 08:58:37.525322 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.virt.hardware [None req-a090db7e-660b-4512-9f21-1b5949159346 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Flavor pref 0:0:0 {{(pid=116227) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 08:58:37.525923 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.virt.hardware [None req-a090db7e-660b-4512-9f21-1b5949159346 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Image pref 0:0:0 {{(pid=116227) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 08:58:37.526574 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.virt.hardware [None req-a090db7e-660b-4512-9f21-1b5949159346 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116227) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 08:58:37.554354 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a090db7e-660b-4512-9f21-1b5949159346 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:37.556791 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a090db7e-660b-4512-9f21-1b5949159346 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:37.560020 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a090db7e-660b-4512-9f21-1b5949159346 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:37.560719 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a090db7e-660b-4512-9f21-1b5949159346 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:37.625893 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.quota [None req-a090db7e-660b-4512-9f21-1b5949159346 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Getting quotas for project 82f534070f974dc882ad415be1a1d3ef. Resources: {'instances', 'ram', 'cores'} {{(pid=116227) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 08:58:37.634590 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-66c4f31f-d028-49dc-940e-81284dca149b tempest-VolumesGetTestJSON-636234082 tempest-VolumesGetTestJSON-636234082-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/432c2861-25bd-41ae-a057-0561d3a3fb18" status: 200 len: 354 microversion: 2.1 time: 0.191954 Nov 23 08:58:37.635557 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 5/6] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 23 08:58:37 2021] GET /compute/v2.1/os-volumes/432c2861-25bd-41ae-a057-0561d3a3fb18 => generated 354 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:58:37.648725 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.quota [None req-a090db7e-660b-4512-9f21-1b5949159346 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Getting quotas for user 0642f1d3e0da400ebba9d029f63a95ce and project 82f534070f974dc882ad415be1a1d3ef. Resources: {'instances', 'ram', 'cores'} {{(pid=116227) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 08:58:37.665589 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-7f7cc7ff-f82a-4cfa-b0c2-940722f134a9 tempest-VolumesGetTestJSON-636234082 tempest-VolumesGetTestJSON-636234082-project] Calling method '.version_select at 0x7f527af2b310>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:37.675532 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-a090db7e-660b-4512-9f21-1b5949159346 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Going to run 1 instances... {{(pid=116227) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 08:58:37.679000 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-a090db7e-660b-4512-9f21-1b5949159346 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 0f78026a-3a7c-46df-bc8b-8cf227c87354] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='18424a16-ac32-42d5-8161-d6cb36423de3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116227) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 08:58:37.805980 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-a090db7e-660b-4512-9f21-1b5949159346 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.278612 Nov 23 08:58:37.811308 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 2/7] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 23 08:58:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 2285 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 08:58:37.827261 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-bc70b32f-bb49-4a05-ab04-90b3c2db7795 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:37.827878 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-bc70b32f-bb49-4a05-ab04-90b3c2db7795 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 0f78026a-3a7c-46df-bc8b-8cf227c87354] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:58:37.853699 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-7f7cc7ff-f82a-4cfa-b0c2-940722f134a9 tempest-VolumesGetTestJSON-636234082 tempest-VolumesGetTestJSON-636234082-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/432c2861-25bd-41ae-a057-0561d3a3fb18" status: 202 len: 0 microversion: 2.1 time: 0.191587 Nov 23 08:58:37.858796 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 6/8] 10.222.0.46 () {58 vars in 1247 bytes} [Tue Nov 23 08:58:37 2021] DELETE /compute/v2.1/os-volumes/432c2861-25bd-41ae-a057-0561d3a3fb18 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 08:58:37.865956 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-7e1a9a41-bf90-429f-9211-17857bbda24c tempest-VolumesGetTestJSON-636234082 tempest-VolumesGetTestJSON-636234082-project] Calling method '.version_select at 0x7f527af2b9d0>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:38.067931 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-7e1a9a41-bf90-429f-9211-17857bbda24c tempest-VolumesGetTestJSON-636234082 tempest-VolumesGetTestJSON-636234082-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/432c2861-25bd-41ae-a057-0561d3a3fb18" status: 200 len: 353 microversion: 2.1 time: 0.207509 Nov 23 08:58:38.068472 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 7/9] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 23 08:58:37 2021] GET /compute/v2.1/os-volumes/432c2861-25bd-41ae-a057-0561d3a3fb18 => generated 353 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:58:38.211691 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-bc70b32f-bb49-4a05-ab04-90b3c2db7795 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:58:38.229433 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-bc70b32f-bb49-4a05-ab04-90b3c2db7795 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354" status: 200 len: 1218 microversion: 2.1 time: 0.414635 Nov 23 08:58:38.232675 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 3/10] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:58:37 2021] GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354 => generated 1218 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:58:38.455708 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-3dbf4100-1ea7-48a8-8d90-ba63553aff0f tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:38.456333 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-3dbf4100-1ea7-48a8-8d90-ba63553aff0f tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:58:38.862308 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-116bf152-67c9-42ea-8916-ba19ac11e57b tempest-VolumesTestJSON-331917586 tempest-VolumesTestJSON-331917586-project] Calling method '.version_select at 0x7f527af27e50>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:38.945365 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-116bf152-67c9-42ea-8916-ba19ac11e57b tempest-VolumesTestJSON-331917586 tempest-VolumesTestJSON-331917586-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/b09addf8-f6e3-493b-8a9b-a6417f4d5105" status: 200 len: 351 microversion: 2.1 time: 0.087110 Nov 23 08:58:38.946150 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 4/11] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 23 08:58:38 2021] GET /compute/v2.1/os-volumes/b09addf8-f6e3-493b-8a9b-a6417f4d5105 => generated 351 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:58:39.082995 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-3dbf4100-1ea7-48a8-8d90-ba63553aff0f tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460e9ced9648454dabe601930a8321e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ccfb93758054da3a7ba7a802b01ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:58:39.091851 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-e668212d-d3ac-4a85-81e2-2d3cb21387f7 tempest-VolumesGetTestJSON-636234082 tempest-VolumesGetTestJSON-636234082-project] Calling method '.version_select at 0x7f527af32160>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:39.118602 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-3dbf4100-1ea7-48a8-8d90-ba63553aff0f tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39" status: 200 len: 1215 microversion: 2.1 time: 0.663400 Nov 23 08:58:39.123124 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 8/12] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:58:38 2021] GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39 => generated 1215 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:58:39.244968 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.wsgi [None req-e668212d-d3ac-4a85-81e2-2d3cb21387f7 tempest-VolumesGetTestJSON-636234082 tempest-VolumesGetTestJSON-636234082-project] HTTP exception thrown: Volume 432c2861-25bd-41ae-a057-0561d3a3fb18 could not be found. Nov 23 08:58:39.246109 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-e668212d-d3ac-4a85-81e2-2d3cb21387f7 tempest-VolumesGetTestJSON-636234082 tempest-VolumesGetTestJSON-636234082-project] Returning 404 to user: Volume 432c2861-25bd-41ae-a057-0561d3a3fb18 could not be found. {{(pid=116227) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 08:58:39.247586 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-e668212d-d3ac-4a85-81e2-2d3cb21387f7 tempest-VolumesGetTestJSON-636234082 tempest-VolumesGetTestJSON-636234082-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/432c2861-25bd-41ae-a057-0561d3a3fb18" status: 404 len: 109 microversion: 2.1 time: 0.171509 Nov 23 08:58:39.251132 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 5/13] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 23 08:58:39 2021] GET /compute/v2.1/os-volumes/432c2861-25bd-41ae-a057-0561d3a3fb18 => generated 109 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 23 08:58:39.251279 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-4fc7e901-6014-4c16-be41-0eded6184218 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:39.251279 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-4fc7e901-6014-4c16-be41-0eded6184218 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 0f78026a-3a7c-46df-bc8b-8cf227c87354] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:58:39.413758 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-4fc7e901-6014-4c16-be41-0eded6184218 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:58:39.420883 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-4fc7e901-6014-4c16-be41-0eded6184218 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354" status: 200 len: 1218 microversion: 2.1 time: 0.175501 Nov 23 08:58:39.427796 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 9/14] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:58:39 2021] GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354 => generated 1218 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:58:40.141488 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-528edea5-9ac7-4147-93d1-8422a25fa8b7 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:40.142243 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-528edea5-9ac7-4147-93d1-8422a25fa8b7 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:58:40.160276 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-528edea5-9ac7-4147-93d1-8422a25fa8b7 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:40.160739 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-528edea5-9ac7-4147-93d1-8422a25fa8b7 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:40.161585 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-528edea5-9ac7-4147-93d1-8422a25fa8b7 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:40.162032 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-528edea5-9ac7-4147-93d1-8422a25fa8b7 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:40.444765 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-3c615f14-0081-4410-84ac-a3f00b875b60 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:40.445521 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-3c615f14-0081-4410-84ac-a3f00b875b60 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 0f78026a-3a7c-46df-bc8b-8cf227c87354] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:58:40.461507 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3c615f14-0081-4410-84ac-a3f00b875b60 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:40.462029 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3c615f14-0081-4410-84ac-a3f00b875b60 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:40.462897 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3c615f14-0081-4410-84ac-a3f00b875b60 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:40.463411 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3c615f14-0081-4410-84ac-a3f00b875b60 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:40.604626 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-528edea5-9ac7-4147-93d1-8422a25fa8b7 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460e9ced9648454dabe601930a8321e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ccfb93758054da3a7ba7a802b01ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:58:40.619596 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-528edea5-9ac7-4147-93d1-8422a25fa8b7 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39" status: 200 len: 1219 microversion: 2.1 time: 0.481670 Nov 23 08:58:40.629523 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 6/15] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:58:40 2021] GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39 => generated 1219 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:58:40.778543 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-3c615f14-0081-4410-84ac-a3f00b875b60 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:58:40.804492 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-3c615f14-0081-4410-84ac-a3f00b875b60 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354" status: 200 len: 1222 microversion: 2.1 time: 0.360930 Nov 23 08:58:40.807062 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 10/16] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:58:40 2021] GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354 => generated 1222 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:58:41.640149 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-198a3825-c004-45db-bf2a-7862179f9d2d tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:41.640743 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-198a3825-c004-45db-bf2a-7862179f9d2d tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:58:41.707406 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-198a3825-c004-45db-bf2a-7862179f9d2d tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:41.715842 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-198a3825-c004-45db-bf2a-7862179f9d2d tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:41.719354 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-198a3825-c004-45db-bf2a-7862179f9d2d tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:41.725831 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-198a3825-c004-45db-bf2a-7862179f9d2d tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:41.826697 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-387114b4-97c3-497d-95d0-e9987561ec29 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:41.829000 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-387114b4-97c3-497d-95d0-e9987561ec29 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 0f78026a-3a7c-46df-bc8b-8cf227c87354] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:58:41.836376 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-387114b4-97c3-497d-95d0-e9987561ec29 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:41.837153 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-387114b4-97c3-497d-95d0-e9987561ec29 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:41.841424 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-387114b4-97c3-497d-95d0-e9987561ec29 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:41.842128 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-387114b4-97c3-497d-95d0-e9987561ec29 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:42.041378 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-387114b4-97c3-497d-95d0-e9987561ec29 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:58:42.070586 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-387114b4-97c3-497d-95d0-e9987561ec29 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354" status: 200 len: 1222 microversion: 2.1 time: 0.244901 Nov 23 08:58:42.075299 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 11/17] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:58:41 2021] GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354 => generated 1222 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:58:42.141135 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c262b654-e6f6-4c6a-8a4f-ee74576cc418 tempest-VolumesTestJSON-331917586 tempest-VolumesTestJSON-331917586-project] Calling method '.version_select at 0x7f527af224c0>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:42.174268 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-198a3825-c004-45db-bf2a-7862179f9d2d tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460e9ced9648454dabe601930a8321e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ccfb93758054da3a7ba7a802b01ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:58:42.184069 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-198a3825-c004-45db-bf2a-7862179f9d2d tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39" status: 200 len: 1219 microversion: 2.1 time: 0.549087 Nov 23 08:58:42.185812 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 7/18] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:58:41 2021] GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39 => generated 1219 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:58:42.320748 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c262b654-e6f6-4c6a-8a4f-ee74576cc418 tempest-VolumesTestJSON-331917586 tempest-VolumesTestJSON-331917586-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/3aed99f3-d028-4ad3-94d3-7140f2ea9660" status: 200 len: 350 microversion: 2.1 time: 0.242684 Nov 23 08:58:42.321492 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 12/19] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 23 08:58:42 2021] GET /compute/v2.1/os-volumes/3aed99f3-d028-4ad3-94d3-7140f2ea9660 => generated 350 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:58:42.333634 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-85190d2a-a775-4b48-abb2-ff064808c510 tempest-VolumesTestJSON-331917586 tempest-VolumesTestJSON-331917586-project] Calling method '.version_select at 0x7f527aeb5a60>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:42.586231 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-85190d2a-a775-4b48-abb2-ff064808c510 tempest-VolumesTestJSON-331917586 tempest-VolumesTestJSON-331917586-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.256143 Nov 23 08:58:42.587172 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 8/20] 10.222.0.46 () {58 vars in 1133 bytes} [Tue Nov 23 08:58:42 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:58:42.606783 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-4e396f2e-ebf0-4be8-97cb-c88f378cfd40 tempest-VolumesTestJSON-331917586 tempest-VolumesTestJSON-331917586-project] Calling method '.version_select at 0x7f527aeaeaf0>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:42.907239 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-4e396f2e-ebf0-4be8-97cb-c88f378cfd40 tempest-VolumesTestJSON-331917586 tempest-VolumesTestJSON-331917586-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.310865 Nov 23 08:58:42.909258 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 13/21] 10.222.0.46 () {58 vars in 1148 bytes} [Tue Nov 23 08:58:42 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:58:42.920347 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-81897eb4-2be0-4751-aed0-7e8384f308cc tempest-VolumesTestJSON-331917586 tempest-VolumesTestJSON-331917586-project] Calling method '.version_select at 0x7f527aed8ee0>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:43.094913 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-ac72fa49-1922-42a5-aaae-e3a70800e73a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:43.096678 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-ac72fa49-1922-42a5-aaae-e3a70800e73a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 0f78026a-3a7c-46df-bc8b-8cf227c87354] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:58:43.108707 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ac72fa49-1922-42a5-aaae-e3a70800e73a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:43.109186 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ac72fa49-1922-42a5-aaae-e3a70800e73a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:43.109995 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ac72fa49-1922-42a5-aaae-e3a70800e73a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:43.110437 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ac72fa49-1922-42a5-aaae-e3a70800e73a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:43.137613 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-81897eb4-2be0-4751-aed0-7e8384f308cc tempest-VolumesTestJSON-331917586 tempest-VolumesTestJSON-331917586-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.221117 Nov 23 08:58:43.141882 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 9/22] 10.222.0.46 () {58 vars in 1133 bytes} [Tue Nov 23 08:58:42 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:58:43.151730 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-3718bda2-4b1b-40e5-b300-f244d643a634 tempest-VolumesTestJSON-331917586 tempest-VolumesTestJSON-331917586-project] Calling method '.version_select at 0x7f527ae675e0>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:43.346714 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-3718bda2-4b1b-40e5-b300-f244d643a634 tempest-VolumesTestJSON-331917586 tempest-VolumesTestJSON-331917586-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.200223 Nov 23 08:58:43.347954 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 10/23] 10.222.0.46 () {58 vars in 1166 bytes} [Tue Nov 23 08:58:43 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:58:43.360642 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-337ea28c-dbc0-4e89-b175-6e1c6e3c94d2 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:43.362243 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-337ea28c-dbc0-4e89-b175-6e1c6e3c94d2 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:58:43.379583 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-337ea28c-dbc0-4e89-b175-6e1c6e3c94d2 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:43.380042 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-337ea28c-dbc0-4e89-b175-6e1c6e3c94d2 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:43.387040 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-337ea28c-dbc0-4e89-b175-6e1c6e3c94d2 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:43.387505 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-337ea28c-dbc0-4e89-b175-6e1c6e3c94d2 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:43.507185 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-ac72fa49-1922-42a5-aaae-e3a70800e73a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:58:43.514996 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-ac72fa49-1922-42a5-aaae-e3a70800e73a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354" status: 200 len: 1270 microversion: 2.1 time: 0.423965 Nov 23 08:58:43.515575 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 14/24] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:58:43 2021] GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354 => generated 1270 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:58:43.531530 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a3e2597d-007a-43aa-abd5-08c9a2645979 tempest-VolumesTestJSON-331917586 tempest-VolumesTestJSON-331917586-project] Calling method '.version_select at 0x7f527af22790>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:43.748262 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a3e2597d-007a-43aa-abd5-08c9a2645979 tempest-VolumesTestJSON-331917586 tempest-VolumesTestJSON-331917586-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.223104 Nov 23 08:58:43.748845 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 15/25] 10.222.0.46 () {58 vars in 1169 bytes} [Tue Nov 23 08:58:43 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:58:43.761149 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-2677f7ab-be06-4c57-865c-a9790be560fd tempest-VolumesTestJSON-331917586 tempest-VolumesTestJSON-331917586-project] Calling method '.version_select at 0x7f527ae7fc10>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:43.969676 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-2677f7ab-be06-4c57-865c-a9790be560fd tempest-VolumesTestJSON-331917586 tempest-VolumesTestJSON-331917586-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.211962 Nov 23 08:58:43.970607 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 16/26] 10.222.0.46 () {58 vars in 1154 bytes} [Tue Nov 23 08:58:43 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:58:43.981946 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-fb421183-59ce-4eb9-994f-424c6054f3b0 tempest-VolumesTestJSON-331917586 tempest-VolumesTestJSON-331917586-project] Calling method '.version_select at 0x7f527ae7f4c0>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:44.100379 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-337ea28c-dbc0-4e89-b175-6e1c6e3c94d2 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460e9ced9648454dabe601930a8321e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ccfb93758054da3a7ba7a802b01ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:58:44.110868 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-337ea28c-dbc0-4e89-b175-6e1c6e3c94d2 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39" status: 200 len: 1273 microversion: 2.1 time: 0.761667 Nov 23 08:58:44.117212 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 11/27] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:58:43 2021] GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39 => generated 1273 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:58:44.533478 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-541fb31e-e4e9-45e6-92bb-37e221a6be80 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:44.534386 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-541fb31e-e4e9-45e6-92bb-37e221a6be80 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 0f78026a-3a7c-46df-bc8b-8cf227c87354] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:58:44.551163 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-541fb31e-e4e9-45e6-92bb-37e221a6be80 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:44.555904 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-fb421183-59ce-4eb9-994f-424c6054f3b0 tempest-VolumesTestJSON-331917586 tempest-VolumesTestJSON-331917586-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.577630 Nov 23 08:58:44.563370 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 17/28] 10.222.0.46 () {58 vars in 1187 bytes} [Tue Nov 23 08:58:43 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:58:44.563576 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-541fb31e-e4e9-45e6-92bb-37e221a6be80 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:44.572390 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-5cf5b9dd-0b99-4af2-bcce-5085e5b3b3f9 tempest-VolumesTestJSON-331917586 tempest-VolumesTestJSON-331917586-project] Calling method '.version_select at 0x7f527aec2040>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:44.572621 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-541fb31e-e4e9-45e6-92bb-37e221a6be80 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:44.573271 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-541fb31e-e4e9-45e6-92bb-37e221a6be80 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:44.929757 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-5cf5b9dd-0b99-4af2-bcce-5085e5b3b3f9 tempest-VolumesTestJSON-331917586 tempest-VolumesTestJSON-331917586-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.364221 Nov 23 08:58:44.931237 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 18/29] 10.222.0.46 () {58 vars in 1154 bytes} [Tue Nov 23 08:58:44 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:58:45.132350 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d0f03a68-3527-4fb7-8816-74bd036b218a tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:45.133327 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d0f03a68-3527-4fb7-8816-74bd036b218a tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:58:45.149761 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d0f03a68-3527-4fb7-8816-74bd036b218a tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:45.161745 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d0f03a68-3527-4fb7-8816-74bd036b218a tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:45.163029 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d0f03a68-3527-4fb7-8816-74bd036b218a tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:45.167164 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d0f03a68-3527-4fb7-8816-74bd036b218a tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:45.261536 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-541fb31e-e4e9-45e6-92bb-37e221a6be80 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:58:45.277073 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-541fb31e-e4e9-45e6-92bb-37e221a6be80 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354" status: 200 len: 1276 microversion: 2.1 time: 0.747841 Nov 23 08:58:45.281618 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 12/30] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:58:44 2021] GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354 => generated 1276 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:58:45.483685 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d0f03a68-3527-4fb7-8816-74bd036b218a tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460e9ced9648454dabe601930a8321e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ccfb93758054da3a7ba7a802b01ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:58:45.496110 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d0f03a68-3527-4fb7-8816-74bd036b218a tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39" status: 200 len: 1273 microversion: 2.1 time: 0.367140 Nov 23 08:58:45.500439 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 19/31] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:58:45 2021] GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39 => generated 1273 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:58:46.301241 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-d2fee0c8-4158-444c-a2e0-67359803e07a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:46.302149 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-d2fee0c8-4158-444c-a2e0-67359803e07a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 0f78026a-3a7c-46df-bc8b-8cf227c87354] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:58:46.335405 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d2fee0c8-4158-444c-a2e0-67359803e07a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:46.335979 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d2fee0c8-4158-444c-a2e0-67359803e07a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:46.351398 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d2fee0c8-4158-444c-a2e0-67359803e07a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:46.365144 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d2fee0c8-4158-444c-a2e0-67359803e07a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:46.869933 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-084866af-5d12-405e-851c-0ea66c495ae8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'create', calling method: .version_select at 0x7f527af22dc0>, body: {"keypair": {"name": "tempest-keypair-1485152784"}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:58:46.927604 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-084866af-5d12-405e-851c-0ea66c495ae8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Getting quotas for project e25886501fbd4758b06603593508fd2c. Resources: {'key_pairs'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 08:58:46.932840 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-084866af-5d12-405e-851c-0ea66c495ae8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Getting quotas for user deddc2bd931e42168ab8f2256a77fe70 and project e25886501fbd4758b06603593508fd2c. Resources: {'key_pairs'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 08:58:47.567857 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-d2fee0c8-4158-444c-a2e0-67359803e07a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:58:47.587934 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-d2fee0c8-4158-444c-a2e0-67359803e07a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354" status: 200 len: 1318 microversion: 2.1 time: 1.289763 Nov 23 08:58:47.604898 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 13/32] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:58:46 2021] GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354 => generated 1318 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:58:47.617855 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-084866af-5d12-405e-851c-0ea66c495ae8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Getting quotas for project e25886501fbd4758b06603593508fd2c. Resources: {'key_pairs'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 08:58:47.626281 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-330fc83e-b009-430c-a33f-78b5ecbf911f tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:47.628647 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-330fc83e-b009-430c-a33f-78b5ecbf911f tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:58:47.638096 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-084866af-5d12-405e-851c-0ea66c495ae8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Getting quotas for user deddc2bd931e42168ab8f2256a77fe70 and project e25886501fbd4758b06603593508fd2c. Resources: {'key_pairs'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 08:58:47.663337 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-330fc83e-b009-430c-a33f-78b5ecbf911f tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:47.665021 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-330fc83e-b009-430c-a33f-78b5ecbf911f tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:47.666294 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-330fc83e-b009-430c-a33f-78b5ecbf911f tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:47.674841 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-330fc83e-b009-430c-a33f-78b5ecbf911f tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:47.697564 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-084866af-5d12-405e-851c-0ea66c495ae8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 1.343158 Nov 23 08:58:47.705570 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 20/33] 10.222.0.46 () {62 vars in 1198 bytes} [Tue Nov 23 08:58:46 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 1353 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 23 08:58:47.931633 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-330fc83e-b009-430c-a33f-78b5ecbf911f tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460e9ced9648454dabe601930a8321e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ccfb93758054da3a7ba7a802b01ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:58:47.944962 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-330fc83e-b009-430c-a33f-78b5ecbf911f tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39" status: 200 len: 1273 microversion: 2.1 time: 0.336296 Nov 23 08:58:47.946487 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 14/34] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:58:47 2021] GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39 => generated 1273 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:58:48.608763 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8db30815-1434-476a-909d-d9d1535bd9fb tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:48.610050 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-8db30815-1434-476a-909d-d9d1535bd9fb tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 0f78026a-3a7c-46df-bc8b-8cf227c87354] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:58:48.617426 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8db30815-1434-476a-909d-d9d1535bd9fb tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:48.634014 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8db30815-1434-476a-909d-d9d1535bd9fb tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:48.636405 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8db30815-1434-476a-909d-d9d1535bd9fb tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:48.638491 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8db30815-1434-476a-909d-d9d1535bd9fb tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:48.963853 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-8ac88c5e-23ec-4620-b557-873283338b8b tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:48.965097 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-8ac88c5e-23ec-4620-b557-873283338b8b tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:58:48.973825 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8ac88c5e-23ec-4620-b557-873283338b8b tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:48.978143 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8ac88c5e-23ec-4620-b557-873283338b8b tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:48.981756 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8ac88c5e-23ec-4620-b557-873283338b8b tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:48.982372 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8ac88c5e-23ec-4620-b557-873283338b8b tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:49.035394 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-8db30815-1434-476a-909d-d9d1535bd9fb tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:58:49.050678 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-8db30815-1434-476a-909d-d9d1535bd9fb tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354" status: 200 len: 1318 microversion: 2.1 time: 0.445417 Nov 23 08:58:49.059620 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 21/35] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:58:48 2021] GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354 => generated 1318 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:58:49.480002 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-6c0ca8db-bec1-4669-b8fc-5d8f3b329bdb tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-619095283", "imageRef": "18424a16-ac32-42d5-8161-d6cb36423de3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8fcd271c-ecf0-4b17-bfb1-8442a8fbe13c"}]}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:58:49.661763 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.network.neutron [None req-6c0ca8db-bec1-4669-b8fc-5d8f3b329bdb tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] validate_networks() for [('8fcd271c-ecf0-4b17-bfb1-8442a8fbe13c', None, None, None, None, None)] {{(pid=116226) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 08:58:50.874603 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-8ac88c5e-23ec-4620-b557-873283338b8b tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460e9ced9648454dabe601930a8321e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ccfb93758054da3a7ba7a802b01ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:58:50.896601 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-8ac88c5e-23ec-4620-b557-873283338b8b tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39" status: 200 len: 1315 microversion: 2.1 time: 1.936511 Nov 23 08:58:50.903448 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 15/36] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:58:48 2021] GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39 => generated 1315 bytes in 1944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:58:50.943813 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-a8185fc0-ba22-45cb-b649-9586efe35523 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:50.950793 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-a8185fc0-ba22-45cb-b649-9586efe35523 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 0f78026a-3a7c-46df-bc8b-8cf227c87354] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:58:50.975495 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a8185fc0-ba22-45cb-b649-9586efe35523 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:50.977941 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a8185fc0-ba22-45cb-b649-9586efe35523 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:50.988262 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a8185fc0-ba22-45cb-b649-9586efe35523 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:50.990546 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a8185fc0-ba22-45cb-b649-9586efe35523 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:52.249936 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-a8185fc0-ba22-45cb-b649-9586efe35523 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:58:52.259386 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-a8185fc0-ba22-45cb-b649-9586efe35523 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354" status: 200 len: 1318 microversion: 2.1 time: 1.352130 Nov 23 08:58:52.281842 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 16/37] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:58:50 2021] GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354 => generated 1318 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:58:52.440104 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-1de366df-1844-4e55-8d47-581c7e8baa38 req-e1de8081-08ec-4643-adf3-f0ca00aca155 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f78026a-3a7c-46df-bc8b-8cf227c87354", "tag": "a8efe016-048d-473e-bb9a-b6758d97be0a"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:58:52.450958 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 08:58:52.450958 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 08:58:52.515882 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-1de366df-1844-4e55-8d47-581c7e8baa38 req-e1de8081-08ec-4643-adf3-f0ca00aca155 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:52.524314 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-1de366df-1844-4e55-8d47-581c7e8baa38 req-e1de8081-08ec-4643-adf3-f0ca00aca155 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:52.617747 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-6c0ca8db-bec1-4669-b8fc-5d8f3b329bdb tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Flavor limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 08:58:52.618355 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-6c0ca8db-bec1-4669-b8fc-5d8f3b329bdb tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Image limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 08:58:52.619077 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-6c0ca8db-bec1-4669-b8fc-5d8f3b329bdb tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Flavor pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 08:58:52.619610 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-6c0ca8db-bec1-4669-b8fc-5d8f3b329bdb tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Image pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 08:58:52.620247 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-6c0ca8db-bec1-4669-b8fc-5d8f3b329bdb tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 08:58:52.666190 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-1de366df-1844-4e55-8d47-581c7e8baa38 req-e1de8081-08ec-4643-adf3-f0ca00aca155 service nova] Creating event network-changed:a8efe016-048d-473e-bb9a-b6758d97be0a for instance 0f78026a-3a7c-46df-bc8b-8cf227c87354 on hv-cinder-76845 Nov 23 08:58:52.670246 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6c0ca8db-bec1-4669-b8fc-5d8f3b329bdb tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:52.670563 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-1de366df-1844-4e55-8d47-581c7e8baa38 req-e1de8081-08ec-4643-adf3-f0ca00aca155 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116227) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 23 08:58:52.671933 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ef667a20-5975-478b-bcd8-34e26d19b228 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:52.674966 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6c0ca8db-bec1-4669-b8fc-5d8f3b329bdb tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:52.682232 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ef667a20-5975-478b-bcd8-34e26d19b228 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:52.683068 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6c0ca8db-bec1-4669-b8fc-5d8f3b329bdb tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:52.690858 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6c0ca8db-bec1-4669-b8fc-5d8f3b329bdb tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:52.692930 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ef667a20-5975-478b-bcd8-34e26d19b228 None None] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:52.693607 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ef667a20-5975-478b-bcd8-34e26d19b228 None None] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:52.734940 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.compute.rpcapi [None req-ef667a20-5975-478b-bcd8-34e26d19b228 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 23 08:58:52.737669 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ef667a20-5975-478b-bcd8-34e26d19b228 None None] Releasing lock "compute-rpcapi-router" {{(pid=116227) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 23 08:58:52.777434 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-6c0ca8db-bec1-4669-b8fc-5d8f3b329bdb tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Getting quotas for project 10a0e7a1377f47a380bd0bb5a9c9ef48. Resources: {'instances', 'ram', 'cores'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 08:58:52.795293 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-6c0ca8db-bec1-4669-b8fc-5d8f3b329bdb tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Getting quotas for user 49c4f403b6604aa796ab8da53c0803b4 and project 10a0e7a1377f47a380bd0bb5a9c9ef48. Resources: {'instances', 'ram', 'cores'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 08:58:52.797598 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-ef667a20-5975-478b-bcd8-34e26d19b228 None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.512126 Nov 23 08:58:52.806743 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 17/38] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 08:58:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:58:52.806743 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-7147d350-a4cc-49d1-b935-8fe5a6594f70 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:52.810208 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-7147d350-a4cc-49d1-b935-8fe5a6594f70 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:58:52.820816 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-6c0ca8db-bec1-4669-b8fc-5d8f3b329bdb tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Going to run 1 instances... {{(pid=116226) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 08:58:52.823207 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-6c0ca8db-bec1-4669-b8fc-5d8f3b329bdb tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='18424a16-ac32-42d5-8161-d6cb36423de3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116226) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 08:58:52.839451 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7147d350-a4cc-49d1-b935-8fe5a6594f70 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:52.840004 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7147d350-a4cc-49d1-b935-8fe5a6594f70 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:52.844051 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7147d350-a4cc-49d1-b935-8fe5a6594f70 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:52.847338 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7147d350-a4cc-49d1-b935-8fe5a6594f70 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:52.945984 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-6c0ca8db-bec1-4669-b8fc-5d8f3b329bdb tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.882409 Nov 23 08:58:52.954852 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 22/39] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 23 08:58:49 2021] POST /compute/v2.1/servers => generated 383 bytes in 3894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 08:58:52.984580 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-cb68ac32-6f1d-4453-83ab-bd867b6aec50 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:52.993083 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-cb68ac32-6f1d-4453-83ab-bd867b6aec50 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:58:53.236114 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-cb68ac32-6f1d-4453-83ab-bd867b6aec50 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:58:53.252695 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-cb68ac32-6f1d-4453-83ab-bd867b6aec50 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1221 microversion: 2.1 time: 0.288790 Nov 23 08:58:53.253415 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 23/40] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:58:52 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1221 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:58:53.305548 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-bce41d02-f82d-4b19-9fd6-8c7d313a8652 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:53.308303 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-bce41d02-f82d-4b19-9fd6-8c7d313a8652 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 0f78026a-3a7c-46df-bc8b-8cf227c87354] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:58:53.358398 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bce41d02-f82d-4b19-9fd6-8c7d313a8652 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:53.363029 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bce41d02-f82d-4b19-9fd6-8c7d313a8652 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:53.368281 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bce41d02-f82d-4b19-9fd6-8c7d313a8652 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:53.369825 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bce41d02-f82d-4b19-9fd6-8c7d313a8652 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:54.373608 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-bce41d02-f82d-4b19-9fd6-8c7d313a8652 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:58:54.385762 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-bce41d02-f82d-4b19-9fd6-8c7d313a8652 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354" status: 200 len: 1318 microversion: 2.1 time: 1.103012 Nov 23 08:58:54.387373 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 24/41] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:58:53 2021] GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354 => generated 1318 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:58:54.402574 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-9e77ddb6-ad28-4951-ad17-bbbf7efa5b69 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-456768492", "imageRef": "18424a16-ac32-42d5-8161-d6cb36423de3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8fcd271c-ecf0-4b17-bfb1-8442a8fbe13c"}]}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:58:54.539619 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.network.neutron [None req-9e77ddb6-ad28-4951-ad17-bbbf7efa5b69 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] validate_networks() for [('8fcd271c-ecf0-4b17-bfb1-8442a8fbe13c', None, None, None, None, None)] {{(pid=116226) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 08:58:54.584015 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-7147d350-a4cc-49d1-b935-8fe5a6594f70 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460e9ced9648454dabe601930a8321e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ccfb93758054da3a7ba7a802b01ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:58:54.602563 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-7147d350-a4cc-49d1-b935-8fe5a6594f70 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39" status: 200 len: 1315 microversion: 2.1 time: 1.802190 Nov 23 08:58:54.603388 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 18/42] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:58:52 2021] GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39 => generated 1315 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:58:54.923380 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-4df5ba90-adea-43a7-990b-33a1968d722d tempest-VolumesNegativeTest-583559531 tempest-VolumesNegativeTest-583559531-project] Action: 'create', calling method: .version_select at 0x7f527af325e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-252755807", "metadata": {"Type": "work"}}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:58:54.925578 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-4df5ba90-adea-43a7-990b-33a1968d722d tempest-VolumesNegativeTest-583559531 tempest-VolumesNegativeTest-583559531-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116227) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 08:58:54.926546 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-4df5ba90-adea-43a7-990b-33a1968d722d tempest-VolumesNegativeTest-583559531 tempest-VolumesNegativeTest-583559531-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.321995 Nov 23 08:58:54.927251 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 19/43] 10.222.0.46 () {60 vars in 1155 bytes} [Tue Nov 23 08:58:54 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 323 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 23 08:58:54.941338 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-b273a456-ff6a-4ae5-b508-219926cfb90a tempest-VolumesNegativeTest-583559531 tempest-VolumesNegativeTest-583559531-project] Action: 'create', calling method: .version_select at 0x7f527ae82a60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1855056313", "metadata": {"Type": "work"}}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:58:54.943274 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-b273a456-ff6a-4ae5-b508-219926cfb90a tempest-VolumesNegativeTest-583559531 tempest-VolumesNegativeTest-583559531-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116227) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 08:58:54.945736 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-b273a456-ff6a-4ae5-b508-219926cfb90a tempest-VolumesNegativeTest-583559531 tempest-VolumesNegativeTest-583559531-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012574 Nov 23 08:58:54.946637 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 20/44] 10.222.0.46 () {60 vars in 1155 bytes} [Tue Nov 23 08:58:54 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 23 08:58:54.957979 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-24a627dc-1da3-4ba2-b54f-0fa9309cf723 tempest-VolumesNegativeTest-583559531 tempest-VolumesNegativeTest-583559531-project] Action: 'create', calling method: .version_select at 0x7f527ae33790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-549149999", "metadata": {"Type": "work"}}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:58:54.959448 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-24a627dc-1da3-4ba2-b54f-0fa9309cf723 tempest-VolumesNegativeTest-583559531 tempest-VolumesNegativeTest-583559531-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116227) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 08:58:54.960581 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-24a627dc-1da3-4ba2-b54f-0fa9309cf723 tempest-VolumesNegativeTest-583559531 tempest-VolumesNegativeTest-583559531-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008420 Nov 23 08:58:54.962096 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 21/45] 10.222.0.46 () {60 vars in 1155 bytes} [Tue Nov 23 08:58:54 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 23 08:58:55.182575 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-92d35f03-c0d1-4ff9-914d-bf89fa734619 req-d34c1f10-779e-4789-a8a3-06d56f2367c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60d6e5d5-d743-4b20-9b13-602e635d1c39", "tag": "d6b7a840-3e22-4af8-ae32-3c470529acca"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:58:55.184080 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 08:58:55.184080 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 08:58:55.200181 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-92d35f03-c0d1-4ff9-914d-bf89fa734619 req-d34c1f10-779e-4789-a8a3-06d56f2367c9 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:55.207229 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-92d35f03-c0d1-4ff9-914d-bf89fa734619 req-d34c1f10-779e-4789-a8a3-06d56f2367c9 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:55.247680 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-92d35f03-c0d1-4ff9-914d-bf89fa734619 req-d34c1f10-779e-4789-a8a3-06d56f2367c9 service nova] Creating event network-changed:d6b7a840-3e22-4af8-ae32-3c470529acca for instance 60d6e5d5-d743-4b20-9b13-602e635d1c39 on hv-cinder-76845 Nov 23 08:58:55.259468 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-92d35f03-c0d1-4ff9-914d-bf89fa734619 req-d34c1f10-779e-4789-a8a3-06d56f2367c9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.292515 Nov 23 08:58:55.260618 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 22/46] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 08:58:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 08:58:55.269692 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-f1d59501-436b-49cd-b20c-af248aba71d9 tempest-VolumesNegativeTest-583559531 tempest-VolumesNegativeTest-583559531-project] Calling method '.version_select at 0x7f527aed8dc0>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:55.323916 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.wsgi [None req-f1d59501-436b-49cd-b20c-af248aba71d9 tempest-VolumesNegativeTest-583559531 tempest-VolumesNegativeTest-583559531-project] HTTP exception thrown: Volume tempest-invalid-1849437277 could not be found. Nov 23 08:58:55.324596 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-f1d59501-436b-49cd-b20c-af248aba71d9 tempest-VolumesNegativeTest-583559531 tempest-VolumesNegativeTest-583559531-project] Returning 404 to user: Volume tempest-invalid-1849437277 could not be found. {{(pid=116227) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 08:58:55.325464 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-f1d59501-436b-49cd-b20c-af248aba71d9 tempest-VolumesNegativeTest-583559531 tempest-VolumesNegativeTest-583559531-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1849437277" status: 404 len: 99 microversion: 2.1 time: 0.063488 Nov 23 08:58:55.326480 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 23/47] 10.222.0.46 () {58 vars in 1217 bytes} [Tue Nov 23 08:58:55 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1849437277 => generated 99 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 23 08:58:55.337204 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-13fb905d-51db-4c7e-9d08-f5d0d70082f6 tempest-VolumesNegativeTest-583559531 tempest-VolumesNegativeTest-583559531-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004215 Nov 23 08:58:55.338639 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 24/48] 10.222.0.46 () {58 vars in 1139 bytes} [Tue Nov 23 08:58:55 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Nov 23 08:58:55.347377 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-824cba16-acdd-4a10-9d9b-94f834164375 tempest-VolumesNegativeTest-583559531 tempest-VolumesNegativeTest-583559531-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003909 Nov 23 08:58:55.347933 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 25/49] 10.222.0.46 () {58 vars in 1136 bytes} [Tue Nov 23 08:58:55 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 23 08:58:55.356953 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-89265f0a-40db-4ea8-aa48-8244a13aaa05 tempest-VolumesNegativeTest-583559531 tempest-VolumesNegativeTest-583559531-project] Calling method '.version_select at 0x7f527b786a60>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:55.401248 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.wsgi [None req-89265f0a-40db-4ea8-aa48-8244a13aaa05 tempest-VolumesNegativeTest-583559531 tempest-VolumesNegativeTest-583559531-project] HTTP exception thrown: Volume 126518a5-440f-4e18-b94e-ae449b368f15 could not be found. Nov 23 08:58:55.402042 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-89265f0a-40db-4ea8-aa48-8244a13aaa05 tempest-VolumesNegativeTest-583559531 tempest-VolumesNegativeTest-583559531-project] Returning 404 to user: Volume 126518a5-440f-4e18-b94e-ae449b368f15 could not be found. {{(pid=116227) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 08:58:55.403299 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-89265f0a-40db-4ea8-aa48-8244a13aaa05 tempest-VolumesNegativeTest-583559531 tempest-VolumesNegativeTest-583559531-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/126518a5-440f-4e18-b94e-ae449b368f15" status: 404 len: 109 microversion: 2.1 time: 0.049824 Nov 23 08:58:55.404432 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 26/50] 10.222.0.46 () {58 vars in 1247 bytes} [Tue Nov 23 08:58:55 2021] DELETE /compute/v2.1/os-volumes/126518a5-440f-4e18-b94e-ae449b368f15 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 08:58:55.414325 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-32582be7-63ad-4802-9cee-e1466cbbaa76 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:55.415361 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-32582be7-63ad-4802-9cee-e1466cbbaa76 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 0f78026a-3a7c-46df-bc8b-8cf227c87354] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:58:55.426858 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-32582be7-63ad-4802-9cee-e1466cbbaa76 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:55.428440 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-32582be7-63ad-4802-9cee-e1466cbbaa76 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:55.429510 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-32582be7-63ad-4802-9cee-e1466cbbaa76 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:55.434404 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-32582be7-63ad-4802-9cee-e1466cbbaa76 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:56.878550 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-32582be7-63ad-4802-9cee-e1466cbbaa76 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:58:56.892618 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-32582be7-63ad-4802-9cee-e1466cbbaa76 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354" status: 200 len: 1318 microversion: 2.1 time: 1.486788 Nov 23 08:58:56.893375 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 27/51] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:58:55 2021] GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354 => generated 1318 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:58:56.907032 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-ed34bf46-b1e0-4465-bd8a-3cc1781d93e6 tempest-VolumesNegativeTest-583559531 tempest-VolumesNegativeTest-583559531-project] Calling method '.version_select at 0x7f527ae829d0>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:56.956274 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.wsgi [None req-ed34bf46-b1e0-4465-bd8a-3cc1781d93e6 tempest-VolumesNegativeTest-583559531 tempest-VolumesNegativeTest-583559531-project] HTTP exception thrown: Volume e18bf36b-27c1-44fc-98f3-aa2154a97690 could not be found. Nov 23 08:58:56.956949 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-ed34bf46-b1e0-4465-bd8a-3cc1781d93e6 tempest-VolumesNegativeTest-583559531 tempest-VolumesNegativeTest-583559531-project] Returning 404 to user: Volume e18bf36b-27c1-44fc-98f3-aa2154a97690 could not be found. {{(pid=116227) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 08:58:56.958022 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-ed34bf46-b1e0-4465-bd8a-3cc1781d93e6 tempest-VolumesNegativeTest-583559531 tempest-VolumesNegativeTest-583559531-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/e18bf36b-27c1-44fc-98f3-aa2154a97690" status: 404 len: 109 microversion: 2.1 time: 0.063728 Nov 23 08:58:56.967992 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 28/52] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 23 08:58:56 2021] GET /compute/v2.1/os-volumes/e18bf36b-27c1-44fc-98f3-aa2154a97690 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 08:58:56.974974 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-23c89898-be02-407f-8da7-624383a3d079 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:56.976893 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-23c89898-be02-407f-8da7-624383a3d079 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:58:56.999764 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-23c89898-be02-407f-8da7-624383a3d079 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:57.004096 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-23c89898-be02-407f-8da7-624383a3d079 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:57.005373 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-23c89898-be02-407f-8da7-624383a3d079 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:57.006009 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-23c89898-be02-407f-8da7-624383a3d079 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:57.382694 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-23c89898-be02-407f-8da7-624383a3d079 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460e9ced9648454dabe601930a8321e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ccfb93758054da3a7ba7a802b01ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:58:57.403021 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-23c89898-be02-407f-8da7-624383a3d079 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39" status: 200 len: 1315 microversion: 2.1 time: 0.433099 Nov 23 08:58:57.423908 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 29/53] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:58:56 2021] GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39 => generated 1315 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:58:57.910200 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-033d9fa5-2923-49c5-9663-16497cc97017 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:57.911905 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-033d9fa5-2923-49c5-9663-16497cc97017 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 0f78026a-3a7c-46df-bc8b-8cf227c87354] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:58:57.918902 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-033d9fa5-2923-49c5-9663-16497cc97017 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:57.921827 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-033d9fa5-2923-49c5-9663-16497cc97017 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:57.922885 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-033d9fa5-2923-49c5-9663-16497cc97017 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:57.926032 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-033d9fa5-2923-49c5-9663-16497cc97017 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:58.080537 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-9e77ddb6-ad28-4951-ad17-bbbf7efa5b69 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Flavor limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 08:58:58.081048 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-9e77ddb6-ad28-4951-ad17-bbbf7efa5b69 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Image limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 08:58:58.082034 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-9e77ddb6-ad28-4951-ad17-bbbf7efa5b69 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Flavor pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 08:58:58.082453 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-9e77ddb6-ad28-4951-ad17-bbbf7efa5b69 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Image pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 08:58:58.082865 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-9e77ddb6-ad28-4951-ad17-bbbf7efa5b69 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 08:58:58.091614 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9e77ddb6-ad28-4951-ad17-bbbf7efa5b69 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:58.092073 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9e77ddb6-ad28-4951-ad17-bbbf7efa5b69 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:58.092889 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9e77ddb6-ad28-4951-ad17-bbbf7efa5b69 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:58.093358 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9e77ddb6-ad28-4951-ad17-bbbf7efa5b69 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:58.135892 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-9e77ddb6-ad28-4951-ad17-bbbf7efa5b69 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Getting quotas for project 10a0e7a1377f47a380bd0bb5a9c9ef48. Resources: {'instances', 'ram', 'cores'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 08:58:58.144624 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-9e77ddb6-ad28-4951-ad17-bbbf7efa5b69 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Getting quotas for user 49c4f403b6604aa796ab8da53c0803b4 and project 10a0e7a1377f47a380bd0bb5a9c9ef48. Resources: {'instances', 'ram', 'cores'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 08:58:58.169666 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-9e77ddb6-ad28-4951-ad17-bbbf7efa5b69 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Going to run 1 instances... {{(pid=116226) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 08:58:58.173386 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-9e77ddb6-ad28-4951-ad17-bbbf7efa5b69 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='18424a16-ac32-42d5-8161-d6cb36423de3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116226) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 08:58:58.270534 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-9e77ddb6-ad28-4951-ad17-bbbf7efa5b69 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.878844 Nov 23 08:58:58.275242 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 25/54] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 23 08:58:54 2021] POST /compute/v2.1/servers => generated 383 bytes in 3884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 08:58:58.280996 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f93b2330-60ae-4555-acaf-a9c0645e6005 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-758094943", "imageRef": "18424a16-ac32-42d5-8161-d6cb36423de3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "173e57ff-5d80-4e2b-b8fe-bc64d9610472"}], "security_groups": [{"name": "tempest-securitygroup--1767003886"}], "key_name": "tempest-keypair-1485152784", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:58:58.649618 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-033d9fa5-2923-49c5-9663-16497cc97017 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:58:58.658653 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-033d9fa5-2923-49c5-9663-16497cc97017 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354" status: 200 len: 1318 microversion: 2.1 time: 0.752434 Nov 23 08:58:58.660044 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 30/55] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:58:57 2021] GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354 => generated 1318 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:58:58.664832 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-cab8b796-5210-4e46-93be-179d083a9211 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:58.665757 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-cab8b796-5210-4e46-93be-179d083a9211 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:58:58.719635 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.network.neutron [None req-f93b2330-60ae-4555-acaf-a9c0645e6005 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] validate_networks() for [('173e57ff-5d80-4e2b-b8fe-bc64d9610472', None, None, None, None, None)] {{(pid=116226) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 08:58:58.769597 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-cab8b796-5210-4e46-93be-179d083a9211 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:58:58.791818 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-cab8b796-5210-4e46-93be-179d083a9211 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1221 microversion: 2.1 time: 0.130297 Nov 23 08:58:58.793948 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 31/56] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:58:58 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1221 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:58:58.809096 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-6acf2918-c25e-425f-a2ef-1270f32c28fc tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:58.812437 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-6acf2918-c25e-425f-a2ef-1270f32c28fc tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:58:58.827936 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6acf2918-c25e-425f-a2ef-1270f32c28fc tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:58.828399 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6acf2918-c25e-425f-a2ef-1270f32c28fc tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:58.829504 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6acf2918-c25e-425f-a2ef-1270f32c28fc tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:58.830079 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6acf2918-c25e-425f-a2ef-1270f32c28fc tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:59.124807 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-6acf2918-c25e-425f-a2ef-1270f32c28fc tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460e9ced9648454dabe601930a8321e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ccfb93758054da3a7ba7a802b01ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:58:59.136449 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-6acf2918-c25e-425f-a2ef-1270f32c28fc tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39" status: 200 len: 1315 microversion: 2.1 time: 0.337053 Nov 23 08:58:59.139859 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 32/57] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:58:58 2021] GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39 => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:58:59.692352 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-9f877873-f4ff-40bb-8be5-72b518ba3c3e tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:58:59.694366 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-9f877873-f4ff-40bb-8be5-72b518ba3c3e tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 0f78026a-3a7c-46df-bc8b-8cf227c87354] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:58:59.717631 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9f877873-f4ff-40bb-8be5-72b518ba3c3e tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:59.720682 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9f877873-f4ff-40bb-8be5-72b518ba3c3e tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:58:59.727714 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9f877873-f4ff-40bb-8be5-72b518ba3c3e tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:58:59.728496 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9f877873-f4ff-40bb-8be5-72b518ba3c3e tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:00.177438 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-9f877873-f4ff-40bb-8be5-72b518ba3c3e tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:00.179405 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-f93b2330-60ae-4555-acaf-a9c0645e6005 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Flavor limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 08:59:00.179817 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-f93b2330-60ae-4555-acaf-a9c0645e6005 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Image limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 08:59:00.180354 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-f93b2330-60ae-4555-acaf-a9c0645e6005 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Flavor pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 08:59:00.180839 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-f93b2330-60ae-4555-acaf-a9c0645e6005 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Image pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 08:59:00.181388 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-f93b2330-60ae-4555-acaf-a9c0645e6005 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 08:59:00.190132 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-9f877873-f4ff-40bb-8be5-72b518ba3c3e tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354" status: 200 len: 1318 microversion: 2.1 time: 0.515061 Nov 23 08:59:00.196024 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f93b2330-60ae-4555-acaf-a9c0645e6005 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:00.196611 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f93b2330-60ae-4555-acaf-a9c0645e6005 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:00.197596 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f93b2330-60ae-4555-acaf-a9c0645e6005 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:00.198153 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f93b2330-60ae-4555-acaf-a9c0645e6005 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:00.202523 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 33/58] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:58:59 2021] GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354 => generated 1318 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:00.213236 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-210866a0-6786-4790-9262-299d34102fff tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:00.214673 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-210866a0-6786-4790-9262-299d34102fff tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:00.222680 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-210866a0-6786-4790-9262-299d34102fff tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:00.223775 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-210866a0-6786-4790-9262-299d34102fff tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:00.224635 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-210866a0-6786-4790-9262-299d34102fff tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:00.225087 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-210866a0-6786-4790-9262-299d34102fff tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:00.244781 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-f93b2330-60ae-4555-acaf-a9c0645e6005 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Getting quotas for project e25886501fbd4758b06603593508fd2c. Resources: {'instances', 'ram', 'cores'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 08:59:00.252455 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-f93b2330-60ae-4555-acaf-a9c0645e6005 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Getting quotas for user deddc2bd931e42168ab8f2256a77fe70 and project e25886501fbd4758b06603593508fd2c. Resources: {'instances', 'ram', 'cores'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 08:59:00.269891 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f93b2330-60ae-4555-acaf-a9c0645e6005 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Going to run 1 instances... {{(pid=116226) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 08:59:00.272232 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f93b2330-60ae-4555-acaf-a9c0645e6005 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='18424a16-ac32-42d5-8161-d6cb36423de3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116226) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 08:59:00.344438 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f93b2330-60ae-4555-acaf-a9c0645e6005 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.065574 Nov 23 08:59:00.353237 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 26/59] 10.222.0.46 () {62 vars in 1187 bytes} [Tue Nov 23 08:58:58 2021] POST /compute/v2.1/servers => generated 402 bytes in 2072 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 23 08:59:00.359619 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-06692498-88de-4871-8d22-86fb5d7e8dbc tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:00.360514 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-06692498-88de-4871-8d22-86fb5d7e8dbc tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:00.372080 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-06692498-88de-4871-8d22-86fb5d7e8dbc tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:00.372535 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-06692498-88de-4871-8d22-86fb5d7e8dbc tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:00.373419 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-06692498-88de-4871-8d22-86fb5d7e8dbc tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:00.373859 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-06692498-88de-4871-8d22-86fb5d7e8dbc tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:00.503275 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-210866a0-6786-4790-9262-299d34102fff tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:00.511742 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-210866a0-6786-4790-9262-299d34102fff tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1279 microversion: 2.1 time: 0.305804 Nov 23 08:59:00.515549 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 34/60] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:00 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1279 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:00.546014 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-8f1b30d2-cc55-4b4f-87c9-c10b635c9a36 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:00.546014 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-8f1b30d2-cc55-4b4f-87c9-c10b635c9a36 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:00.645543 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-8f1b30d2-cc55-4b4f-87c9-c10b635c9a36 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:00.648660 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-8f1b30d2-cc55-4b4f-87c9-c10b635c9a36 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:00.652988 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-8f1b30d2-cc55-4b4f-87c9-c10b635c9a36 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:00.655442 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-8f1b30d2-cc55-4b4f-87c9-c10b635c9a36 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1281 microversion: 2.20 time: 0.138814 Nov 23 08:59:00.657834 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 35/61] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 08:59:00 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1281 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 08:59:00.774748 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-06692498-88de-4871-8d22-86fb5d7e8dbc tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460e9ced9648454dabe601930a8321e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ccfb93758054da3a7ba7a802b01ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:00.787264 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-06692498-88de-4871-8d22-86fb5d7e8dbc tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39" status: 200 len: 1315 microversion: 2.1 time: 0.427128 Nov 23 08:59:00.788104 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 27/62] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:00 2021] GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39 => generated 1315 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:01.212314 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-0a71fa67-87f5-4420-8b2e-b9af1f3f1453 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:01.212950 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-0a71fa67-87f5-4420-8b2e-b9af1f3f1453 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 0f78026a-3a7c-46df-bc8b-8cf227c87354] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:01.228810 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0a71fa67-87f5-4420-8b2e-b9af1f3f1453 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:01.229312 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0a71fa67-87f5-4420-8b2e-b9af1f3f1453 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:01.230142 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0a71fa67-87f5-4420-8b2e-b9af1f3f1453 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:01.235024 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0a71fa67-87f5-4420-8b2e-b9af1f3f1453 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:01.430506 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-0a71fa67-87f5-4420-8b2e-b9af1f3f1453 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:01.440188 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-0a71fa67-87f5-4420-8b2e-b9af1f3f1453 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354" status: 200 len: 1318 microversion: 2.1 time: 0.234975 Nov 23 08:59:01.445791 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 36/63] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:01 2021] GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:01.534385 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-6e11dc1e-9ca7-4b22-8153-092e5ae954ab tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:01.535001 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-6e11dc1e-9ca7-4b22-8153-092e5ae954ab tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:01.545733 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6e11dc1e-9ca7-4b22-8153-092e5ae954ab tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:01.546284 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6e11dc1e-9ca7-4b22-8153-092e5ae954ab tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:01.547196 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6e11dc1e-9ca7-4b22-8153-092e5ae954ab tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:01.548142 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6e11dc1e-9ca7-4b22-8153-092e5ae954ab tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:01.671997 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-37d17028-71b3-4a06-ac7c-557f62a28e0b req-daece601-f6a0-4644-b14a-d51136748de8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e7614ff-90ad-4ed2-9d48-3b0585258f88", "tag": "6a5bc769-b686-4f1b-aa8b-1993d134c1f8"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:01.674247 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 08:59:01.674247 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 08:59:01.695459 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-37d17028-71b3-4a06-ac7c-557f62a28e0b req-daece601-f6a0-4644-b14a-d51136748de8 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:01.695918 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-37d17028-71b3-4a06-ac7c-557f62a28e0b req-daece601-f6a0-4644-b14a-d51136748de8 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:01.713140 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-37d17028-71b3-4a06-ac7c-557f62a28e0b req-daece601-f6a0-4644-b14a-d51136748de8 service nova] Creating event network-changed:6a5bc769-b686-4f1b-aa8b-1993d134c1f8 for instance 4e7614ff-90ad-4ed2-9d48-3b0585258f88 on hv-cinder-76845 Nov 23 08:59:01.718609 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-37d17028-71b3-4a06-ac7c-557f62a28e0b req-daece601-f6a0-4644-b14a-d51136748de8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050641 Nov 23 08:59:01.719419 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 37/64] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 08:59:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:59:01.725318 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-62368556-d2b4-40aa-9a18-97c769c4e1dd tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:01.725782 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-62368556-d2b4-40aa-9a18-97c769c4e1dd tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:01.734686 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-62368556-d2b4-40aa-9a18-97c769c4e1dd tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:01.735943 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-62368556-d2b4-40aa-9a18-97c769c4e1dd tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:01.736955 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-62368556-d2b4-40aa-9a18-97c769c4e1dd tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:01.737988 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-62368556-d2b4-40aa-9a18-97c769c4e1dd tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:01.790589 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-6e11dc1e-9ca7-4b22-8153-092e5ae954ab tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:01.800785 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-6e11dc1e-9ca7-4b22-8153-092e5ae954ab tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1321 microversion: 2.1 time: 0.271524 Nov 23 08:59:01.801713 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 28/65] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:01 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1321 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:01.807368 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-936cb77b-e0cc-48a5-9700-bad0a8ec8d81 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:01.808427 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-936cb77b-e0cc-48a5-9700-bad0a8ec8d81 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:01.809259 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-62368556-d2b4-40aa-9a18-97c769c4e1dd tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:01.815663 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-936cb77b-e0cc-48a5-9700-bad0a8ec8d81 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:01.816349 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-936cb77b-e0cc-48a5-9700-bad0a8ec8d81 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:01.817146 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-936cb77b-e0cc-48a5-9700-bad0a8ec8d81 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:01.817619 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-936cb77b-e0cc-48a5-9700-bad0a8ec8d81 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:01.820504 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-62368556-d2b4-40aa-9a18-97c769c4e1dd tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:01.823324 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-62368556-d2b4-40aa-9a18-97c769c4e1dd tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:01.825707 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-62368556-d2b4-40aa-9a18-97c769c4e1dd tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1277 microversion: 2.20 time: 0.103776 Nov 23 08:59:01.826860 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 38/66] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 08:59:01 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1277 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 08:59:01.964325 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-936cb77b-e0cc-48a5-9700-bad0a8ec8d81 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460e9ced9648454dabe601930a8321e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ccfb93758054da3a7ba7a802b01ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:01.973641 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-936cb77b-e0cc-48a5-9700-bad0a8ec8d81 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39" status: 200 len: 1315 microversion: 2.1 time: 0.170626 Nov 23 08:59:01.974222 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 29/67] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:01 2021] GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:02.458018 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-4704b076-6f00-4399-bf4f-6410322f1407 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:02.458667 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-4704b076-6f00-4399-bf4f-6410322f1407 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 0f78026a-3a7c-46df-bc8b-8cf227c87354] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:02.464353 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4704b076-6f00-4399-bf4f-6410322f1407 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:02.464806 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4704b076-6f00-4399-bf4f-6410322f1407 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:02.465616 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4704b076-6f00-4399-bf4f-6410322f1407 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:02.466112 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4704b076-6f00-4399-bf4f-6410322f1407 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:02.608313 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-4704b076-6f00-4399-bf4f-6410322f1407 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:02.615979 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-4704b076-6f00-4399-bf4f-6410322f1407 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354" status: 200 len: 1318 microversion: 2.1 time: 0.162244 Nov 23 08:59:02.616539 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 39/68] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:02 2021] GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:02.818162 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-7017152d-244f-4842-8d2e-ed331899c622 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:02.818770 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-7017152d-244f-4842-8d2e-ed331899c622 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:02.824565 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7017152d-244f-4842-8d2e-ed331899c622 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:02.825012 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7017152d-244f-4842-8d2e-ed331899c622 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:02.825814 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7017152d-244f-4842-8d2e-ed331899c622 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:02.826252 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7017152d-244f-4842-8d2e-ed331899c622 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:02.844160 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-6844dc34-2a04-421c-9b94-f625ec9f6e95 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:02.846222 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-6844dc34-2a04-421c-9b94-f625ec9f6e95 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:02.852247 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6844dc34-2a04-421c-9b94-f625ec9f6e95 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:02.852697 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6844dc34-2a04-421c-9b94-f625ec9f6e95 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:02.853696 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6844dc34-2a04-421c-9b94-f625ec9f6e95 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:02.854162 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6844dc34-2a04-421c-9b94-f625ec9f6e95 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:02.927533 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-6844dc34-2a04-421c-9b94-f625ec9f6e95 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:02.944983 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-6844dc34-2a04-421c-9b94-f625ec9f6e95 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:02.949031 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-6844dc34-2a04-421c-9b94-f625ec9f6e95 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:02.950419 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-6844dc34-2a04-421c-9b94-f625ec9f6e95 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1277 microversion: 2.20 time: 0.110167 Nov 23 08:59:02.951468 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 40/69] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 08:59:02 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1277 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 08:59:02.986641 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-7017152d-244f-4842-8d2e-ed331899c622 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:02.991038 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-06250439-8414-4799-9c97-cec70b911e2d tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:02.991680 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-06250439-8414-4799-9c97-cec70b911e2d tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:02.994267 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-7017152d-244f-4842-8d2e-ed331899c622 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1321 microversion: 2.1 time: 0.179783 Nov 23 08:59:02.995329 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 30/70] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:02 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:02.997988 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-06250439-8414-4799-9c97-cec70b911e2d tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:02.998513 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-06250439-8414-4799-9c97-cec70b911e2d tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:02.999374 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-06250439-8414-4799-9c97-cec70b911e2d tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:02.999892 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-06250439-8414-4799-9c97-cec70b911e2d tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:03.144398 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-06250439-8414-4799-9c97-cec70b911e2d tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460e9ced9648454dabe601930a8321e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ccfb93758054da3a7ba7a802b01ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:03.154517 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-06250439-8414-4799-9c97-cec70b911e2d tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39" status: 200 len: 1315 microversion: 2.1 time: 0.164358 Nov 23 08:59:03.162580 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 41/71] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:02 2021] GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:03.632682 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d20efe7e-937c-4db8-a585-17c793a226e7 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:03.633323 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d20efe7e-937c-4db8-a585-17c793a226e7 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 0f78026a-3a7c-46df-bc8b-8cf227c87354] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:03.639094 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d20efe7e-937c-4db8-a585-17c793a226e7 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:03.639548 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d20efe7e-937c-4db8-a585-17c793a226e7 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:03.640319 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d20efe7e-937c-4db8-a585-17c793a226e7 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:03.640752 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d20efe7e-937c-4db8-a585-17c793a226e7 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:03.775512 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d20efe7e-937c-4db8-a585-17c793a226e7 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:03.783791 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d20efe7e-937c-4db8-a585-17c793a226e7 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354" status: 200 len: 1318 microversion: 2.1 time: 0.154688 Nov 23 08:59:03.784351 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 31/72] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:03 2021] GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:03.970754 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-f069353f-71d1-4c20-90c5-23e3d35429b2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:03.971527 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-f069353f-71d1-4c20-90c5-23e3d35429b2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:03.978793 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f069353f-71d1-4c20-90c5-23e3d35429b2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:03.983297 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f069353f-71d1-4c20-90c5-23e3d35429b2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:03.984332 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f069353f-71d1-4c20-90c5-23e3d35429b2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:03.989537 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f069353f-71d1-4c20-90c5-23e3d35429b2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:04.015350 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c195597f-4372-453c-952e-fd46b807ef2e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:04.017318 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c195597f-4372-453c-952e-fd46b807ef2e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:04.026299 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c195597f-4372-453c-952e-fd46b807ef2e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:04.027500 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c195597f-4372-453c-952e-fd46b807ef2e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:04.029032 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c195597f-4372-453c-952e-fd46b807ef2e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:04.029942 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c195597f-4372-453c-952e-fd46b807ef2e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:04.122399 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-f069353f-71d1-4c20-90c5-23e3d35429b2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:04.136446 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-f069353f-71d1-4c20-90c5-23e3d35429b2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:04.143931 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-f069353f-71d1-4c20-90c5-23e3d35429b2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:04.147976 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-f069353f-71d1-4c20-90c5-23e3d35429b2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1277 microversion: 2.20 time: 0.181587 Nov 23 08:59:04.151109 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 42/73] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 08:59:03 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1277 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 08:59:04.169640 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-d2943909-e8d9-4682-b3ed-0aef9baa77a3 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:04.170318 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-d2943909-e8d9-4682-b3ed-0aef9baa77a3 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:04.179769 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d2943909-e8d9-4682-b3ed-0aef9baa77a3 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:04.182205 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d2943909-e8d9-4682-b3ed-0aef9baa77a3 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:04.184334 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d2943909-e8d9-4682-b3ed-0aef9baa77a3 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:04.186095 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d2943909-e8d9-4682-b3ed-0aef9baa77a3 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:04.537733 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-c195597f-4372-453c-952e-fd46b807ef2e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:04.546681 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c195597f-4372-453c-952e-fd46b807ef2e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1321 microversion: 2.1 time: 0.537733 Nov 23 08:59:04.556563 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 32/74] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:04 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1321 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:04.561963 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-d2943909-e8d9-4682-b3ed-0aef9baa77a3 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460e9ced9648454dabe601930a8321e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ccfb93758054da3a7ba7a802b01ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:04.577981 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-d2943909-e8d9-4682-b3ed-0aef9baa77a3 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39" status: 200 len: 1315 microversion: 2.1 time: 0.406086 Nov 23 08:59:04.578660 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 43/75] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:04 2021] GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39 => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:04.809654 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-3527236b-ba7e-4dbf-bde8-7f9b21855865 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:04.810331 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-3527236b-ba7e-4dbf-bde8-7f9b21855865 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 0f78026a-3a7c-46df-bc8b-8cf227c87354] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:04.818829 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3527236b-ba7e-4dbf-bde8-7f9b21855865 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:04.820372 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3527236b-ba7e-4dbf-bde8-7f9b21855865 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:04.823385 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3527236b-ba7e-4dbf-bde8-7f9b21855865 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:04.823876 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3527236b-ba7e-4dbf-bde8-7f9b21855865 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:04.936088 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-8a231127-799b-443a-aa8a-90ad06326f59 req-a3fc6a59-f48a-4aa7-9f5a-f9f2434bc32b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7360d955-d8b0-49dc-bb7e-a804b8f5246b", "tag": "14b8cc4b-9be8-4f3d-9cd6-e402ed0c9704"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:04.937910 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 08:59:04.937910 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 08:59:04.948545 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-8a231127-799b-443a-aa8a-90ad06326f59 req-a3fc6a59-f48a-4aa7-9f5a-f9f2434bc32b service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:04.949271 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-8a231127-799b-443a-aa8a-90ad06326f59 req-a3fc6a59-f48a-4aa7-9f5a-f9f2434bc32b service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:04.962188 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-8a231127-799b-443a-aa8a-90ad06326f59 req-a3fc6a59-f48a-4aa7-9f5a-f9f2434bc32b service nova] Creating event network-changed:14b8cc4b-9be8-4f3d-9cd6-e402ed0c9704 for instance 7360d955-d8b0-49dc-bb7e-a804b8f5246b on hv-cinder-76845 Nov 23 08:59:04.967271 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-8a231127-799b-443a-aa8a-90ad06326f59 req-a3fc6a59-f48a-4aa7-9f5a-f9f2434bc32b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034872 Nov 23 08:59:04.968152 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 44/76] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 08:59:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 08:59:05.049700 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-3527236b-ba7e-4dbf-bde8-7f9b21855865 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:05.057842 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-3527236b-ba7e-4dbf-bde8-7f9b21855865 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354" status: 200 len: 1318 microversion: 2.1 time: 0.253225 Nov 23 08:59:05.058388 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 33/77] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:04 2021] GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354 => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:05.168095 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-3c7aa193-e311-4df9-92fe-b925422cd1fc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:05.168773 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-3c7aa193-e311-4df9-92fe-b925422cd1fc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:05.175420 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3c7aa193-e311-4df9-92fe-b925422cd1fc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:05.175869 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3c7aa193-e311-4df9-92fe-b925422cd1fc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:05.176640 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3c7aa193-e311-4df9-92fe-b925422cd1fc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:05.177072 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3c7aa193-e311-4df9-92fe-b925422cd1fc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:05.240067 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-3c7aa193-e311-4df9-92fe-b925422cd1fc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:05.247813 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-3c7aa193-e311-4df9-92fe-b925422cd1fc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:05.249347 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-3c7aa193-e311-4df9-92fe-b925422cd1fc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:05.250448 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-3c7aa193-e311-4df9-92fe-b925422cd1fc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1341 microversion: 2.20 time: 0.086435 Nov 23 08:59:05.257197 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 45/78] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 08:59:05 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1341 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 08:59:05.564613 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-2936d3ff-a6f5-4da4-8a66-626f46e4331b tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:05.565292 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-2936d3ff-a6f5-4da4-8a66-626f46e4331b tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:05.571384 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2936d3ff-a6f5-4da4-8a66-626f46e4331b tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:05.571934 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2936d3ff-a6f5-4da4-8a66-626f46e4331b tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:05.572818 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2936d3ff-a6f5-4da4-8a66-626f46e4331b tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:05.573375 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2936d3ff-a6f5-4da4-8a66-626f46e4331b tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:05.596134 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-1e6af50a-07c9-46aa-8681-a2bcd2693916 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:05.596816 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-1e6af50a-07c9-46aa-8681-a2bcd2693916 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:05.604192 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1e6af50a-07c9-46aa-8681-a2bcd2693916 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:05.604856 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1e6af50a-07c9-46aa-8681-a2bcd2693916 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:05.605825 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1e6af50a-07c9-46aa-8681-a2bcd2693916 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:05.614375 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1e6af50a-07c9-46aa-8681-a2bcd2693916 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:05.737363 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-2936d3ff-a6f5-4da4-8a66-626f46e4331b tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:05.744932 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-2936d3ff-a6f5-4da4-8a66-626f46e4331b tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1321 microversion: 2.1 time: 0.184900 Nov 23 08:59:05.745544 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 34/79] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:05 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:05.784118 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-1e6af50a-07c9-46aa-8681-a2bcd2693916 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460e9ced9648454dabe601930a8321e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ccfb93758054da3a7ba7a802b01ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:05.792959 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-1e6af50a-07c9-46aa-8681-a2bcd2693916 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39" status: 200 len: 1315 microversion: 2.1 time: 0.201163 Nov 23 08:59:05.793699 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 46/80] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:05 2021] GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:06.075115 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-2d3e6dc2-9d7b-4c57-a0a4-cfdc413abb08 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:06.075733 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-2d3e6dc2-9d7b-4c57-a0a4-cfdc413abb08 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 0f78026a-3a7c-46df-bc8b-8cf227c87354] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:06.081651 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2d3e6dc2-9d7b-4c57-a0a4-cfdc413abb08 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:06.082028 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2d3e6dc2-9d7b-4c57-a0a4-cfdc413abb08 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:06.082874 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2d3e6dc2-9d7b-4c57-a0a4-cfdc413abb08 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:06.083269 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2d3e6dc2-9d7b-4c57-a0a4-cfdc413abb08 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:06.222788 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-2d3e6dc2-9d7b-4c57-a0a4-cfdc413abb08 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:06.230195 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-2d3e6dc2-9d7b-4c57-a0a4-cfdc413abb08 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354" status: 200 len: 1318 microversion: 2.1 time: 0.158624 Nov 23 08:59:06.231053 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 35/81] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:06 2021] GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:06.268901 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-4cb3c7c5-b83d-429d-a04e-34a3842539f5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:06.269561 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-4cb3c7c5-b83d-429d-a04e-34a3842539f5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:06.275335 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4cb3c7c5-b83d-429d-a04e-34a3842539f5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:06.275792 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4cb3c7c5-b83d-429d-a04e-34a3842539f5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:06.276579 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4cb3c7c5-b83d-429d-a04e-34a3842539f5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:06.277019 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4cb3c7c5-b83d-429d-a04e-34a3842539f5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:06.338157 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-4cb3c7c5-b83d-429d-a04e-34a3842539f5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:06.347085 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-4cb3c7c5-b83d-429d-a04e-34a3842539f5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:06.348752 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-4cb3c7c5-b83d-429d-a04e-34a3842539f5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:06.349954 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-4cb3c7c5-b83d-429d-a04e-34a3842539f5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1341 microversion: 2.20 time: 0.085451 Nov 23 08:59:06.350537 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 47/82] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 08:59:06 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1341 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 08:59:06.763263 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f9ef5cb0-5c1e-4589-9fc0-0af3fea68397 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:06.763964 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f9ef5cb0-5c1e-4589-9fc0-0af3fea68397 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:06.770560 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f9ef5cb0-5c1e-4589-9fc0-0af3fea68397 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:06.771014 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f9ef5cb0-5c1e-4589-9fc0-0af3fea68397 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:06.771795 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f9ef5cb0-5c1e-4589-9fc0-0af3fea68397 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:06.772274 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f9ef5cb0-5c1e-4589-9fc0-0af3fea68397 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:06.812546 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-1f542a60-d0d1-4e14-a277-0a8434c4b515 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:06.813929 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-1f542a60-d0d1-4e14-a277-0a8434c4b515 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:06.823579 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1f542a60-d0d1-4e14-a277-0a8434c4b515 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:06.824035 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1f542a60-d0d1-4e14-a277-0a8434c4b515 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:06.825035 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1f542a60-d0d1-4e14-a277-0a8434c4b515 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:06.825502 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1f542a60-d0d1-4e14-a277-0a8434c4b515 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:06.914174 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-f9ef5cb0-5c1e-4589-9fc0-0af3fea68397 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:06.921408 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f9ef5cb0-5c1e-4589-9fc0-0af3fea68397 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1321 microversion: 2.1 time: 0.161820 Nov 23 08:59:06.922189 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 36/83] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:06 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:06.960078 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-1f542a60-d0d1-4e14-a277-0a8434c4b515 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460e9ced9648454dabe601930a8321e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ccfb93758054da3a7ba7a802b01ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:06.968061 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-1f542a60-d0d1-4e14-a277-0a8434c4b515 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39" status: 200 len: 1315 microversion: 2.1 time: 0.159871 Nov 23 08:59:06.968739 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 48/84] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:06 2021] GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:07.249885 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-9d0e0e9c-840a-4a05-934f-2b8c967f94e0 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:07.250742 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-9d0e0e9c-840a-4a05-934f-2b8c967f94e0 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 0f78026a-3a7c-46df-bc8b-8cf227c87354] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:07.258444 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9d0e0e9c-840a-4a05-934f-2b8c967f94e0 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:07.259363 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9d0e0e9c-840a-4a05-934f-2b8c967f94e0 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:07.260235 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9d0e0e9c-840a-4a05-934f-2b8c967f94e0 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:07.260745 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9d0e0e9c-840a-4a05-934f-2b8c967f94e0 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:07.368688 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-a807513b-c4fa-4c96-a6d6-f9421cbdd12c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:07.369680 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-a807513b-c4fa-4c96-a6d6-f9421cbdd12c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:07.377331 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a807513b-c4fa-4c96-a6d6-f9421cbdd12c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:07.378227 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a807513b-c4fa-4c96-a6d6-f9421cbdd12c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:07.379298 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a807513b-c4fa-4c96-a6d6-f9421cbdd12c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:07.379985 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a807513b-c4fa-4c96-a6d6-f9421cbdd12c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:07.471174 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-a807513b-c4fa-4c96-a6d6-f9421cbdd12c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:07.481875 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-a807513b-c4fa-4c96-a6d6-f9421cbdd12c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:07.483924 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-a807513b-c4fa-4c96-a6d6-f9421cbdd12c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:07.485837 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-a807513b-c4fa-4c96-a6d6-f9421cbdd12c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1351 microversion: 2.20 time: 0.120259 Nov 23 08:59:07.486809 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 49/85] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 08:59:07 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1351 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 08:59:07.945273 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-73f2b838-fbb6-45c6-be5f-4edea70d39fe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:07.946057 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-73f2b838-fbb6-45c6-be5f-4edea70d39fe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:07.960904 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-73f2b838-fbb6-45c6-be5f-4edea70d39fe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:07.961596 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-73f2b838-fbb6-45c6-be5f-4edea70d39fe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:07.962490 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-73f2b838-fbb6-45c6-be5f-4edea70d39fe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:07.963716 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-73f2b838-fbb6-45c6-be5f-4edea70d39fe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:08.015066 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-9d0e0e9c-840a-4a05-934f-2b8c967f94e0 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:08.025545 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-9d0e0e9c-840a-4a05-934f-2b8c967f94e0 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354" status: 200 len: 1318 microversion: 2.1 time: 0.781353 Nov 23 08:59:08.029881 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 37/86] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:07 2021] GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354 => generated 1318 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:08.039140 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-224e55ef-ed72-46b5-b38c-94a63d60542d tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:08.041384 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-224e55ef-ed72-46b5-b38c-94a63d60542d tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:08.053094 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-224e55ef-ed72-46b5-b38c-94a63d60542d tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:08.057078 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-224e55ef-ed72-46b5-b38c-94a63d60542d tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:08.058053 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-224e55ef-ed72-46b5-b38c-94a63d60542d tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:08.058496 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-224e55ef-ed72-46b5-b38c-94a63d60542d tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:08.287675 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-73f2b838-fbb6-45c6-be5f-4edea70d39fe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:08.320184 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-73f2b838-fbb6-45c6-be5f-4edea70d39fe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1321 microversion: 2.1 time: 0.380019 Nov 23 08:59:08.325515 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 50/87] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:07 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1321 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:08.512533 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-7d4d279a-c705-4c30-965e-d4b87cba3239 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:08.513264 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-7d4d279a-c705-4c30-965e-d4b87cba3239 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:08.529739 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7d4d279a-c705-4c30-965e-d4b87cba3239 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:08.530207 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7d4d279a-c705-4c30-965e-d4b87cba3239 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:08.530989 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7d4d279a-c705-4c30-965e-d4b87cba3239 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:08.532392 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7d4d279a-c705-4c30-965e-d4b87cba3239 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:08.623834 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-224e55ef-ed72-46b5-b38c-94a63d60542d tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460e9ced9648454dabe601930a8321e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ccfb93758054da3a7ba7a802b01ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:08.641606 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-224e55ef-ed72-46b5-b38c-94a63d60542d tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39" status: 200 len: 1315 microversion: 2.1 time: 0.607449 Nov 23 08:59:08.644325 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 38/88] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:08 2021] GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39 => generated 1315 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:08.949194 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-7d4d279a-c705-4c30-965e-d4b87cba3239 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:08.959388 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-7d4d279a-c705-4c30-965e-d4b87cba3239 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:08.965272 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-7d4d279a-c705-4c30-965e-d4b87cba3239 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:08.974247 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-7d4d279a-c705-4c30-965e-d4b87cba3239 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1407 microversion: 2.20 time: 0.468219 Nov 23 08:59:08.975051 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 51/89] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 08:59:08 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1407 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 08:59:09.050117 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e5c65377-d10b-4e5a-9273-1de5bd3003eb tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:09.050820 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e5c65377-d10b-4e5a-9273-1de5bd3003eb tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 0f78026a-3a7c-46df-bc8b-8cf227c87354] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:09.071987 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e5c65377-d10b-4e5a-9273-1de5bd3003eb tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:09.072459 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e5c65377-d10b-4e5a-9273-1de5bd3003eb tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:09.073300 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e5c65377-d10b-4e5a-9273-1de5bd3003eb tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:09.073744 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e5c65377-d10b-4e5a-9273-1de5bd3003eb tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:09.343559 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-c6db1531-a4aa-43ad-bf64-768115fd2a32 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:09.345359 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-c6db1531-a4aa-43ad-bf64-768115fd2a32 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:09.359650 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c6db1531-a4aa-43ad-bf64-768115fd2a32 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:09.361430 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c6db1531-a4aa-43ad-bf64-768115fd2a32 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:09.368037 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c6db1531-a4aa-43ad-bf64-768115fd2a32 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:09.380801 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c6db1531-a4aa-43ad-bf64-768115fd2a32 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:09.494902 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-e5c65377-d10b-4e5a-9273-1de5bd3003eb tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:09.503262 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e5c65377-d10b-4e5a-9273-1de5bd3003eb tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354" status: 200 len: 1318 microversion: 2.1 time: 0.459139 Nov 23 08:59:09.525519 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 39/90] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:09 2021] GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354 => generated 1318 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:09.568883 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-5f46a396-d01c-483f-8a4e-4b6bf1b722ef req-f451496f-605e-4df1-b0e1-113e5700241f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82569d71-833c-454b-a668-12dc9a37e7e2", "tag": "efe7e8ac-f495-4361-902c-7da559e50715"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:09.573782 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 08:59:09.573782 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 08:59:09.602512 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-5f46a396-d01c-483f-8a4e-4b6bf1b722ef req-f451496f-605e-4df1-b0e1-113e5700241f service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:09.603484 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-5f46a396-d01c-483f-8a4e-4b6bf1b722ef req-f451496f-605e-4df1-b0e1-113e5700241f service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:09.644929 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-5f46a396-d01c-483f-8a4e-4b6bf1b722ef req-f451496f-605e-4df1-b0e1-113e5700241f service nova] Creating event network-changed:efe7e8ac-f495-4361-902c-7da559e50715 for instance 82569d71-833c-454b-a668-12dc9a37e7e2 on hv-cinder-76845 Nov 23 08:59:09.652811 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-5f46a396-d01c-483f-8a4e-4b6bf1b722ef req-f451496f-605e-4df1-b0e1-113e5700241f service nova] Acquired lock "compute-rpcapi-router" {{(pid=116226) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 23 08:59:09.654227 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0195c424-42ac-4202-8ee9-7a7536c66c06 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:09.655088 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0195c424-42ac-4202-8ee9-7a7536c66c06 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:09.656182 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0195c424-42ac-4202-8ee9-7a7536c66c06 None None] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:09.657029 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0195c424-42ac-4202-8ee9-7a7536c66c06 None None] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:09.687423 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.compute.rpcapi [None req-0195c424-42ac-4202-8ee9-7a7536c66c06 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 23 08:59:09.689032 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0195c424-42ac-4202-8ee9-7a7536c66c06 None None] Releasing lock "compute-rpcapi-router" {{(pid=116226) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 23 08:59:09.747342 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-0195c424-42ac-4202-8ee9-7a7536c66c06 None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183906 Nov 23 08:59:09.748080 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 40/91] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 08:59:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:59:09.753377 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c1baeca2-59bb-4173-9b2c-2ce7f2c5b283 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:09.754285 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c1baeca2-59bb-4173-9b2c-2ce7f2c5b283 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:09.770093 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c1baeca2-59bb-4173-9b2c-2ce7f2c5b283 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:09.770553 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c1baeca2-59bb-4173-9b2c-2ce7f2c5b283 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:09.771343 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c1baeca2-59bb-4173-9b2c-2ce7f2c5b283 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:09.771790 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c1baeca2-59bb-4173-9b2c-2ce7f2c5b283 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:09.946006 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-c6db1531-a4aa-43ad-bf64-768115fd2a32 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:09.957043 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-c6db1531-a4aa-43ad-bf64-768115fd2a32 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1321 microversion: 2.1 time: 0.617667 Nov 23 08:59:09.959574 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 52/92] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:09 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1321 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:09.994148 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-e0682afe-1ccd-439f-bcaf-57fd0ddfe4f9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:09.995015 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-e0682afe-1ccd-439f-bcaf-57fd0ddfe4f9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:10.007815 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e0682afe-1ccd-439f-bcaf-57fd0ddfe4f9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:10.008499 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e0682afe-1ccd-439f-bcaf-57fd0ddfe4f9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:10.009482 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e0682afe-1ccd-439f-bcaf-57fd0ddfe4f9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:10.010067 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e0682afe-1ccd-439f-bcaf-57fd0ddfe4f9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:10.292612 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-c1baeca2-59bb-4173-9b2c-2ce7f2c5b283 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460e9ced9648454dabe601930a8321e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ccfb93758054da3a7ba7a802b01ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:10.307177 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c1baeca2-59bb-4173-9b2c-2ce7f2c5b283 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39" status: 200 len: 1315 microversion: 2.1 time: 0.557729 Nov 23 08:59:10.308139 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 41/93] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:09 2021] GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39 => generated 1315 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:10.477708 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-e0682afe-1ccd-439f-bcaf-57fd0ddfe4f9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:10.490058 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-e0682afe-1ccd-439f-bcaf-57fd0ddfe4f9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:10.492079 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-e0682afe-1ccd-439f-bcaf-57fd0ddfe4f9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:10.513491 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-e0682afe-1ccd-439f-bcaf-57fd0ddfe4f9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1407 microversion: 2.20 time: 0.505575 Nov 23 08:59:10.513491 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 53/94] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 08:59:09 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1407 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 08:59:10.523576 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-60a06b38-0d62-49fc-8032-6a36ca14c282 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:10.524665 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-60a06b38-0d62-49fc-8032-6a36ca14c282 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 0f78026a-3a7c-46df-bc8b-8cf227c87354] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:10.534058 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-60a06b38-0d62-49fc-8032-6a36ca14c282 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:10.535121 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-60a06b38-0d62-49fc-8032-6a36ca14c282 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:10.536350 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-60a06b38-0d62-49fc-8032-6a36ca14c282 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:10.537011 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-60a06b38-0d62-49fc-8032-6a36ca14c282 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:10.555115 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-ea8329dc-410f-4240-a962-d1e06b461f1e req-3f2de3d5-7ff7-4206-b61f-b049cd42e358 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f78026a-3a7c-46df-bc8b-8cf227c87354", "name": "network-vif-plugged", "status": "completed", "tag": "a8efe016-048d-473e-bb9a-b6758d97be0a"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:10.557014 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 08:59:10.557014 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 08:59:10.566597 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-ea8329dc-410f-4240-a962-d1e06b461f1e req-3f2de3d5-7ff7-4206-b61f-b049cd42e358 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:10.567836 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-ea8329dc-410f-4240-a962-d1e06b461f1e req-3f2de3d5-7ff7-4206-b61f-b049cd42e358 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:10.590305 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-ea8329dc-410f-4240-a962-d1e06b461f1e req-3f2de3d5-7ff7-4206-b61f-b049cd42e358 service nova] Creating event network-vif-plugged:a8efe016-048d-473e-bb9a-b6758d97be0a for instance 0f78026a-3a7c-46df-bc8b-8cf227c87354 on hv-cinder-76845 Nov 23 08:59:10.601570 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-ea8329dc-410f-4240-a962-d1e06b461f1e req-3f2de3d5-7ff7-4206-b61f-b049cd42e358 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.290837 Nov 23 08:59:10.604330 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 42/95] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 08:59:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:59:10.805475 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-60a06b38-0d62-49fc-8032-6a36ca14c282 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:10.815083 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-60a06b38-0d62-49fc-8032-6a36ca14c282 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354" status: 200 len: 1318 microversion: 2.1 time: 0.298350 Nov 23 08:59:10.817881 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 54/96] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:10 2021] GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354 => generated 1318 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:10.981366 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-efdeae41-54cd-4620-989f-1a53f4170cff tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:10.982883 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-efdeae41-54cd-4620-989f-1a53f4170cff tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:10.994340 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-efdeae41-54cd-4620-989f-1a53f4170cff tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:10.995491 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-efdeae41-54cd-4620-989f-1a53f4170cff tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:10.996557 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-efdeae41-54cd-4620-989f-1a53f4170cff tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:10.997192 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-efdeae41-54cd-4620-989f-1a53f4170cff tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:11.268652 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-efdeae41-54cd-4620-989f-1a53f4170cff tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:11.283969 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-efdeae41-54cd-4620-989f-1a53f4170cff tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1321 microversion: 2.1 time: 0.309887 Nov 23 08:59:11.284829 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 43/97] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:10 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1321 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:11.330003 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-3f430e81-e352-4538-964f-b635be341c03 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:11.331063 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-3f430e81-e352-4538-964f-b635be341c03 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:11.347627 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3f430e81-e352-4538-964f-b635be341c03 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:11.348186 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3f430e81-e352-4538-964f-b635be341c03 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:11.349078 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3f430e81-e352-4538-964f-b635be341c03 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:11.351873 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3f430e81-e352-4538-964f-b635be341c03 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:11.514674 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-3810d3bb-32ec-4278-9cce-1f5caf99f843 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:11.515318 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-3810d3bb-32ec-4278-9cce-1f5caf99f843 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:11.525625 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3810d3bb-32ec-4278-9cce-1f5caf99f843 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:11.526705 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3810d3bb-32ec-4278-9cce-1f5caf99f843 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:11.528548 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3810d3bb-32ec-4278-9cce-1f5caf99f843 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:11.529722 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3810d3bb-32ec-4278-9cce-1f5caf99f843 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:11.784601 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-3810d3bb-32ec-4278-9cce-1f5caf99f843 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:11.800726 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-3810d3bb-32ec-4278-9cce-1f5caf99f843 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:11.803842 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-3810d3bb-32ec-4278-9cce-1f5caf99f843 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:11.824302 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-3810d3bb-32ec-4278-9cce-1f5caf99f843 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1407 microversion: 2.20 time: 0.295189 Nov 23 08:59:11.828147 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 44/98] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 08:59:11 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1407 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 08:59:11.838821 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f6372c4f-571d-43b5-99c2-75f8d3d62ea7 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:11.839666 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f6372c4f-571d-43b5-99c2-75f8d3d62ea7 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 0f78026a-3a7c-46df-bc8b-8cf227c87354] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:11.872783 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f6372c4f-571d-43b5-99c2-75f8d3d62ea7 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:11.874655 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f6372c4f-571d-43b5-99c2-75f8d3d62ea7 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:11.876312 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f6372c4f-571d-43b5-99c2-75f8d3d62ea7 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:11.876549 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-3f430e81-e352-4538-964f-b635be341c03 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460e9ced9648454dabe601930a8321e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ccfb93758054da3a7ba7a802b01ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:11.876878 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f6372c4f-571d-43b5-99c2-75f8d3d62ea7 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:11.895203 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-3f430e81-e352-4538-964f-b635be341c03 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39" status: 200 len: 1315 microversion: 2.1 time: 0.572816 Nov 23 08:59:11.907592 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 55/99] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:11 2021] GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39 => generated 1315 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:12.179317 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-f6372c4f-571d-43b5-99c2-75f8d3d62ea7 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:12.197197 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f6372c4f-571d-43b5-99c2-75f8d3d62ea7 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354" status: 200 len: 1318 microversion: 2.1 time: 0.362453 Nov 23 08:59:12.203259 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 45/100] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:11 2021] GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354 => generated 1318 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:12.301898 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-626c30ac-748c-4851-86b0-f3f2c7839d99 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:12.302742 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-626c30ac-748c-4851-86b0-f3f2c7839d99 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:12.311886 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-626c30ac-748c-4851-86b0-f3f2c7839d99 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:12.314715 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-626c30ac-748c-4851-86b0-f3f2c7839d99 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:12.315785 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-626c30ac-748c-4851-86b0-f3f2c7839d99 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:12.318572 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-626c30ac-748c-4851-86b0-f3f2c7839d99 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:12.551458 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-626c30ac-748c-4851-86b0-f3f2c7839d99 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:12.561861 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-626c30ac-748c-4851-86b0-f3f2c7839d99 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1321 microversion: 2.1 time: 0.264160 Nov 23 08:59:12.562583 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 56/101] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:12 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:12.623265 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-1203159c-ef8f-4630-8567-bb61f8992f6a req-2d8a7a84-d975-468b-9679-32e126c9e1b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60d6e5d5-d743-4b20-9b13-602e635d1c39", "name": "network-vif-plugged", "status": "completed", "tag": "d6b7a840-3e22-4af8-ae32-3c470529acca"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:12.627835 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 08:59:12.627835 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 08:59:12.637465 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-1203159c-ef8f-4630-8567-bb61f8992f6a req-2d8a7a84-d975-468b-9679-32e126c9e1b4 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:12.639187 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-1203159c-ef8f-4630-8567-bb61f8992f6a req-2d8a7a84-d975-468b-9679-32e126c9e1b4 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:12.653978 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-1203159c-ef8f-4630-8567-bb61f8992f6a req-2d8a7a84-d975-468b-9679-32e126c9e1b4 service nova] Creating event network-vif-plugged:d6b7a840-3e22-4af8-ae32-3c470529acca for instance 60d6e5d5-d743-4b20-9b13-602e635d1c39 on hv-cinder-76845 Nov 23 08:59:12.660078 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-1203159c-ef8f-4630-8567-bb61f8992f6a req-2d8a7a84-d975-468b-9679-32e126c9e1b4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042139 Nov 23 08:59:12.664325 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 46/102] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 08:59:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 08:59:12.847586 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-ae563151-a306-4c1e-9380-4f63dcf218ca tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:12.848319 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-ae563151-a306-4c1e-9380-4f63dcf218ca tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:12.861863 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ae563151-a306-4c1e-9380-4f63dcf218ca tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:12.861863 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ae563151-a306-4c1e-9380-4f63dcf218ca tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:12.861863 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ae563151-a306-4c1e-9380-4f63dcf218ca tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:12.861863 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ae563151-a306-4c1e-9380-4f63dcf218ca tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:12.913746 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a2d82e11-0c24-49a4-b480-579c01efcd12 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:12.914858 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a2d82e11-0c24-49a4-b480-579c01efcd12 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:12.926062 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a2d82e11-0c24-49a4-b480-579c01efcd12 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:12.926946 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a2d82e11-0c24-49a4-b480-579c01efcd12 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:12.928160 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a2d82e11-0c24-49a4-b480-579c01efcd12 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:12.929217 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a2d82e11-0c24-49a4-b480-579c01efcd12 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:13.105617 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-ae563151-a306-4c1e-9380-4f63dcf218ca tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:13.123998 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-ae563151-a306-4c1e-9380-4f63dcf218ca tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:13.127492 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-ae563151-a306-4c1e-9380-4f63dcf218ca tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:13.128895 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-ae563151-a306-4c1e-9380-4f63dcf218ca tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1407 microversion: 2.20 time: 0.286349 Nov 23 08:59:13.129560 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 57/103] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 08:59:12 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1407 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 08:59:13.206748 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a2d82e11-0c24-49a4-b480-579c01efcd12 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460e9ced9648454dabe601930a8321e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ccfb93758054da3a7ba7a802b01ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:13.214875 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a2d82e11-0c24-49a4-b480-579c01efcd12 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39" status: 200 len: 1315 microversion: 2.1 time: 0.306254 Nov 23 08:59:13.215874 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 47/104] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:12 2021] GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:13.221387 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-6602ec7b-4f13-4c07-9e12-b6a8b6840c2c tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:13.221997 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-6602ec7b-4f13-4c07-9e12-b6a8b6840c2c tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 0f78026a-3a7c-46df-bc8b-8cf227c87354] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:13.230633 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6602ec7b-4f13-4c07-9e12-b6a8b6840c2c tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:13.231081 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6602ec7b-4f13-4c07-9e12-b6a8b6840c2c tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:13.234037 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6602ec7b-4f13-4c07-9e12-b6a8b6840c2c tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:13.234482 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6602ec7b-4f13-4c07-9e12-b6a8b6840c2c tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:13.460443 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-6602ec7b-4f13-4c07-9e12-b6a8b6840c2c tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:13.474200 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-6602ec7b-4f13-4c07-9e12-b6a8b6840c2c tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354" status: 200 len: 1507 microversion: 2.1 time: 0.257355 Nov 23 08:59:13.475093 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 58/105] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:13 2021] GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354 => generated 1507 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:13.581243 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a11c39a5-de96-495f-b067-53c62f462e8e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:13.581860 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a11c39a5-de96-495f-b067-53c62f462e8e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:13.597891 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a11c39a5-de96-495f-b067-53c62f462e8e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:13.598357 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a11c39a5-de96-495f-b067-53c62f462e8e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:13.599386 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a11c39a5-de96-495f-b067-53c62f462e8e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:13.599839 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a11c39a5-de96-495f-b067-53c62f462e8e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:13.909963 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a11c39a5-de96-495f-b067-53c62f462e8e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:13.923994 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a11c39a5-de96-495f-b067-53c62f462e8e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1321 microversion: 2.1 time: 0.347900 Nov 23 08:59:13.924955 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 48/106] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:13 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1321 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:14.152541 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-f6ebc95c-b709-44e6-a73b-f6ff7839844e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:14.153457 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-f6ebc95c-b709-44e6-a73b-f6ff7839844e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:14.163868 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f6ebc95c-b709-44e6-a73b-f6ff7839844e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:14.165481 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f6ebc95c-b709-44e6-a73b-f6ff7839844e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:14.167042 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f6ebc95c-b709-44e6-a73b-f6ff7839844e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:14.167677 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f6ebc95c-b709-44e6-a73b-f6ff7839844e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:14.235603 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e3e1299b-5ef0-48a3-a9b7-4e4a6f3dc9d4 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:14.236963 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e3e1299b-5ef0-48a3-a9b7-4e4a6f3dc9d4 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:14.246504 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e3e1299b-5ef0-48a3-a9b7-4e4a6f3dc9d4 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:14.249575 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e3e1299b-5ef0-48a3-a9b7-4e4a6f3dc9d4 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:14.252571 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e3e1299b-5ef0-48a3-a9b7-4e4a6f3dc9d4 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:14.255864 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e3e1299b-5ef0-48a3-a9b7-4e4a6f3dc9d4 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:14.474337 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-f6ebc95c-b709-44e6-a73b-f6ff7839844e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:14.488606 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-f6ebc95c-b709-44e6-a73b-f6ff7839844e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:14.494272 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-f6ebc95c-b709-44e6-a73b-f6ff7839844e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:14.498384 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-f6ebc95c-b709-44e6-a73b-f6ff7839844e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1407 microversion: 2.20 time: 0.354142 Nov 23 08:59:14.500275 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 59/107] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 08:59:14 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1407 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 08:59:14.598093 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-e3e1299b-5ef0-48a3-a9b7-4e4a6f3dc9d4 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460e9ced9648454dabe601930a8321e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ccfb93758054da3a7ba7a802b01ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:14.609013 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e3e1299b-5ef0-48a3-a9b7-4e4a6f3dc9d4 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39" status: 200 len: 1315 microversion: 2.1 time: 0.379368 Nov 23 08:59:14.610282 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 49/108] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:14 2021] GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39 => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:14.679443 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-c61c33fd-b76a-4d50-8514-18aeca1b5227 req-39ad7842-b54a-44df-9da6-72319028efb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7360d955-d8b0-49dc-bb7e-a804b8f5246b", "name": "network-vif-plugged", "status": "completed", "tag": "14b8cc4b-9be8-4f3d-9cd6-e402ed0c9704"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:14.681354 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 08:59:14.681354 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 08:59:14.703852 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-c61c33fd-b76a-4d50-8514-18aeca1b5227 req-39ad7842-b54a-44df-9da6-72319028efb2 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:14.713634 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-c61c33fd-b76a-4d50-8514-18aeca1b5227 req-39ad7842-b54a-44df-9da6-72319028efb2 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:14.736855 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-c61c33fd-b76a-4d50-8514-18aeca1b5227 req-39ad7842-b54a-44df-9da6-72319028efb2 service nova] Creating event network-vif-plugged:14b8cc4b-9be8-4f3d-9cd6-e402ed0c9704 for instance 7360d955-d8b0-49dc-bb7e-a804b8f5246b on hv-cinder-76845 Nov 23 08:59:14.742853 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-c61c33fd-b76a-4d50-8514-18aeca1b5227 req-39ad7842-b54a-44df-9da6-72319028efb2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067847 Nov 23 08:59:14.744411 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 60/109] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 08:59:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:59:14.995539 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-49bbe724-b64c-4821-9fb9-f988d7eb88ae tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:14.998885 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-49bbe724-b64c-4821-9fb9-f988d7eb88ae tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:15.008216 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-49bbe724-b64c-4821-9fb9-f988d7eb88ae tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:15.010135 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-49bbe724-b64c-4821-9fb9-f988d7eb88ae tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:15.016282 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-49bbe724-b64c-4821-9fb9-f988d7eb88ae tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:15.018941 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-49bbe724-b64c-4821-9fb9-f988d7eb88ae tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:15.197948 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-a060a4d0-d894-45aa-912a-49af743bbc71 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "753a654c-d630-486c-8138-695c56b389e2"}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:15.199758 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-a060a4d0-d894-45aa-912a-49af743bbc71 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 0f78026a-3a7c-46df-bc8b-8cf227c87354] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:15.208105 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a060a4d0-d894-45aa-912a-49af743bbc71 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:15.208797 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a060a4d0-d894-45aa-912a-49af743bbc71 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:15.209860 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a060a4d0-d894-45aa-912a-49af743bbc71 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:15.210529 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a060a4d0-d894-45aa-912a-49af743bbc71 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:15.294876 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-49bbe724-b64c-4821-9fb9-f988d7eb88ae tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:15.303603 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-49bbe724-b64c-4821-9fb9-f988d7eb88ae tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1321 microversion: 2.1 time: 0.316646 Nov 23 08:59:15.304216 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 50/110] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:14 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1321 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:15.518088 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-27cd024d-4fdf-42ee-8416-a9c4763f21c2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:15.519614 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-27cd024d-4fdf-42ee-8416-a9c4763f21c2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:15.526511 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-27cd024d-4fdf-42ee-8416-a9c4763f21c2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:15.527071 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-27cd024d-4fdf-42ee-8416-a9c4763f21c2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:15.528013 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-27cd024d-4fdf-42ee-8416-a9c4763f21c2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:15.528539 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-27cd024d-4fdf-42ee-8416-a9c4763f21c2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:15.669047 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-a060a4d0-d894-45aa-912a-49af743bbc71 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "POST /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.476205 Nov 23 08:59:15.670334 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 61/111] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 23 08:59:15 2021] POST /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354/os-volume_attachments => generated 194 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:59:15.685259 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-ff711668-9268-4c22-9de8-6fa64d80a1ae tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:15.691467 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-ff711668-9268-4c22-9de8-6fa64d80a1ae tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:15.700033 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-27cd024d-4fdf-42ee-8416-a9c4763f21c2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:15.702942 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ff711668-9268-4c22-9de8-6fa64d80a1ae tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:15.704825 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ff711668-9268-4c22-9de8-6fa64d80a1ae tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:15.705884 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ff711668-9268-4c22-9de8-6fa64d80a1ae tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:15.707286 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ff711668-9268-4c22-9de8-6fa64d80a1ae tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:15.712560 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-27cd024d-4fdf-42ee-8416-a9c4763f21c2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:15.715513 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-27cd024d-4fdf-42ee-8416-a9c4763f21c2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:15.719142 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-27cd024d-4fdf-42ee-8416-a9c4763f21c2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1407 microversion: 2.20 time: 0.204738 Nov 23 08:59:15.721078 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 51/112] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 08:59:15 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 08:59:15.891036 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-ff711668-9268-4c22-9de8-6fa64d80a1ae tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460e9ced9648454dabe601930a8321e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ccfb93758054da3a7ba7a802b01ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:15.900358 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-ff711668-9268-4c22-9de8-6fa64d80a1ae tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39" status: 200 len: 1502 microversion: 2.1 time: 0.228529 Nov 23 08:59:15.901203 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 62/113] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:15 2021] GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39 => generated 1502 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:16.321678 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c8496419-f81a-433c-a544-c8821b14f9fb tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:16.322277 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c8496419-f81a-433c-a544-c8821b14f9fb tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:16.329590 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c8496419-f81a-433c-a544-c8821b14f9fb tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:16.333402 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c8496419-f81a-433c-a544-c8821b14f9fb tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:16.334388 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c8496419-f81a-433c-a544-c8821b14f9fb tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:16.334848 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c8496419-f81a-433c-a544-c8821b14f9fb tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:16.513327 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-c8496419-f81a-433c-a544-c8821b14f9fb tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:16.523474 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c8496419-f81a-433c-a544-c8821b14f9fb tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1321 microversion: 2.1 time: 0.206381 Nov 23 08:59:16.524254 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 52/114] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:16 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:16.741443 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-5803f0bd-6532-4808-9be5-82d2adc8d5f3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:16.742198 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-5803f0bd-6532-4808-9be5-82d2adc8d5f3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:16.748697 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5803f0bd-6532-4808-9be5-82d2adc8d5f3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:16.751204 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5803f0bd-6532-4808-9be5-82d2adc8d5f3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:16.752662 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5803f0bd-6532-4808-9be5-82d2adc8d5f3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:16.753292 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5803f0bd-6532-4808-9be5-82d2adc8d5f3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:16.759889 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-6cbda90c-985c-4a4a-9656-49e4ee096fac req-0899cd26-0731-4215-8621-d1b5b6327b2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e7614ff-90ad-4ed2-9d48-3b0585258f88", "name": "network-vif-plugged", "status": "completed", "tag": "6a5bc769-b686-4f1b-aa8b-1993d134c1f8"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:16.761563 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 08:59:16.761563 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 08:59:16.769994 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-6cbda90c-985c-4a4a-9656-49e4ee096fac req-0899cd26-0731-4215-8621-d1b5b6327b2c service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:16.770447 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-6cbda90c-985c-4a4a-9656-49e4ee096fac req-0899cd26-0731-4215-8621-d1b5b6327b2c service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:16.789137 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-6cbda90c-985c-4a4a-9656-49e4ee096fac req-0899cd26-0731-4215-8621-d1b5b6327b2c service nova] Creating event network-vif-plugged:6a5bc769-b686-4f1b-aa8b-1993d134c1f8 for instance 4e7614ff-90ad-4ed2-9d48-3b0585258f88 on hv-cinder-76845 Nov 23 08:59:16.794483 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-6cbda90c-985c-4a4a-9656-49e4ee096fac req-0899cd26-0731-4215-8621-d1b5b6327b2c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038214 Nov 23 08:59:16.795622 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 53/115] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 08:59:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:59:16.919991 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-5803f0bd-6532-4808-9be5-82d2adc8d5f3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:16.930055 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-5803f0bd-6532-4808-9be5-82d2adc8d5f3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:16.931549 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-5803f0bd-6532-4808-9be5-82d2adc8d5f3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:16.932847 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-5803f0bd-6532-4808-9be5-82d2adc8d5f3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1407 microversion: 2.20 time: 0.195151 Nov 23 08:59:16.933629 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 63/116] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 08:59:16 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 08:59:17.540858 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-41de1519-94a3-4dfc-9468-ca00239ce9f7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:17.541605 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-41de1519-94a3-4dfc-9468-ca00239ce9f7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:17.548866 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-41de1519-94a3-4dfc-9468-ca00239ce9f7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:17.549824 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-41de1519-94a3-4dfc-9468-ca00239ce9f7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:17.550796 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-41de1519-94a3-4dfc-9468-ca00239ce9f7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:17.551409 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-41de1519-94a3-4dfc-9468-ca00239ce9f7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:17.776848 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-41de1519-94a3-4dfc-9468-ca00239ce9f7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:17.786342 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-41de1519-94a3-4dfc-9468-ca00239ce9f7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1321 microversion: 2.1 time: 0.249272 Nov 23 08:59:17.787211 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 54/117] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:17 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:17.951397 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-bc7f658b-a750-422c-9c48-8c15cce03a02 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:17.951986 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-bc7f658b-a750-422c-9c48-8c15cce03a02 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:17.960029 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-bc7f658b-a750-422c-9c48-8c15cce03a02 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:17.960732 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-bc7f658b-a750-422c-9c48-8c15cce03a02 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:17.961958 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-bc7f658b-a750-422c-9c48-8c15cce03a02 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:17.962787 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-bc7f658b-a750-422c-9c48-8c15cce03a02 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:18.143240 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-bc7f658b-a750-422c-9c48-8c15cce03a02 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:18.152725 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-bc7f658b-a750-422c-9c48-8c15cce03a02 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:18.154295 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-bc7f658b-a750-422c-9c48-8c15cce03a02 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:18.155804 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-bc7f658b-a750-422c-9c48-8c15cce03a02 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1407 microversion: 2.20 time: 0.207897 Nov 23 08:59:18.156797 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 64/118] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 08:59:17 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 08:59:18.804572 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-ed5f1a96-6412-44e8-9a3d-3e5785e64ecf tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:18.805202 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-ed5f1a96-6412-44e8-9a3d-3e5785e64ecf tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:18.814387 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ed5f1a96-6412-44e8-9a3d-3e5785e64ecf tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:18.815414 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ed5f1a96-6412-44e8-9a3d-3e5785e64ecf tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:18.818692 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-2b883e80-34fb-4adb-ab98-912facdf72d6 req-de59dd2a-9485-461e-b8a5-4e01a9a08c42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82569d71-833c-454b-a668-12dc9a37e7e2", "name": "network-vif-plugged", "status": "completed", "tag": "efe7e8ac-f495-4361-902c-7da559e50715"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:18.820573 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 08:59:18.820573 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 08:59:18.821631 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ed5f1a96-6412-44e8-9a3d-3e5785e64ecf tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:18.825250 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ed5f1a96-6412-44e8-9a3d-3e5785e64ecf tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:18.831276 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-2b883e80-34fb-4adb-ab98-912facdf72d6 req-de59dd2a-9485-461e-b8a5-4e01a9a08c42 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:18.831530 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-2b883e80-34fb-4adb-ab98-912facdf72d6 req-de59dd2a-9485-461e-b8a5-4e01a9a08c42 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:18.855954 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-2b883e80-34fb-4adb-ab98-912facdf72d6 req-de59dd2a-9485-461e-b8a5-4e01a9a08c42 service nova] Creating event network-vif-plugged:efe7e8ac-f495-4361-902c-7da559e50715 for instance 82569d71-833c-454b-a668-12dc9a37e7e2 on hv-cinder-76845 Nov 23 08:59:18.862036 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-2b883e80-34fb-4adb-ab98-912facdf72d6 req-de59dd2a-9485-461e-b8a5-4e01a9a08c42 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047194 Nov 23 08:59:18.863396 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 65/119] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 08:59:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:59:19.031332 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-ed5f1a96-6412-44e8-9a3d-3e5785e64ecf tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:19.041245 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-ed5f1a96-6412-44e8-9a3d-3e5785e64ecf tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1321 microversion: 2.1 time: 0.241356 Nov 23 08:59:19.041826 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 55/120] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:18 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:19.177105 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-4ee446af-27ec-49e0-9c16-1861bd29be8d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:19.178184 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-4ee446af-27ec-49e0-9c16-1861bd29be8d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:19.184260 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4ee446af-27ec-49e0-9c16-1861bd29be8d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:19.184786 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4ee446af-27ec-49e0-9c16-1861bd29be8d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:19.185692 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4ee446af-27ec-49e0-9c16-1861bd29be8d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:19.186217 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4ee446af-27ec-49e0-9c16-1861bd29be8d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:19.338529 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-4ee446af-27ec-49e0-9c16-1861bd29be8d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:19.348707 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-4ee446af-27ec-49e0-9c16-1861bd29be8d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:19.350262 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-4ee446af-27ec-49e0-9c16-1861bd29be8d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:19.351596 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-4ee446af-27ec-49e0-9c16-1861bd29be8d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1407 microversion: 2.20 time: 0.179393 Nov 23 08:59:19.352586 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 66/121] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 08:59:19 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 08:59:20.057947 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-fa58a174-0592-4a65-b13f-a43c3fa1992b tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:20.058549 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-fa58a174-0592-4a65-b13f-a43c3fa1992b tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:20.065208 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fa58a174-0592-4a65-b13f-a43c3fa1992b tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:20.065674 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fa58a174-0592-4a65-b13f-a43c3fa1992b tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:20.066636 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fa58a174-0592-4a65-b13f-a43c3fa1992b tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:20.067081 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fa58a174-0592-4a65-b13f-a43c3fa1992b tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:20.211849 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-fa58a174-0592-4a65-b13f-a43c3fa1992b tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:20.219254 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-fa58a174-0592-4a65-b13f-a43c3fa1992b tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1321 microversion: 2.1 time: 0.164874 Nov 23 08:59:20.220276 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 56/122] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:20 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:20.370524 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-77a78a95-c5da-44d1-bd2b-1b689cc3e8bd tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:20.371191 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-77a78a95-c5da-44d1-bd2b-1b689cc3e8bd tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:20.378182 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-77a78a95-c5da-44d1-bd2b-1b689cc3e8bd tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:20.378634 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-77a78a95-c5da-44d1-bd2b-1b689cc3e8bd tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:20.379429 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-77a78a95-c5da-44d1-bd2b-1b689cc3e8bd tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:20.380039 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-77a78a95-c5da-44d1-bd2b-1b689cc3e8bd tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:20.517657 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-77a78a95-c5da-44d1-bd2b-1b689cc3e8bd tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:20.525232 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-77a78a95-c5da-44d1-bd2b-1b689cc3e8bd tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:20.526794 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-77a78a95-c5da-44d1-bd2b-1b689cc3e8bd tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:20.527878 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-77a78a95-c5da-44d1-bd2b-1b689cc3e8bd tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1407 microversion: 2.20 time: 0.161718 Nov 23 08:59:20.528493 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 67/123] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 08:59:20 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 08:59:21.235809 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-fa133ef5-3c50-47da-a7ac-ca803314d8ed tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:21.236408 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-fa133ef5-3c50-47da-a7ac-ca803314d8ed tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:21.242082 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fa133ef5-3c50-47da-a7ac-ca803314d8ed tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:21.242529 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fa133ef5-3c50-47da-a7ac-ca803314d8ed tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:21.243300 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fa133ef5-3c50-47da-a7ac-ca803314d8ed tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:21.243731 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fa133ef5-3c50-47da-a7ac-ca803314d8ed tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:21.381579 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-fa133ef5-3c50-47da-a7ac-ca803314d8ed tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:21.389141 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-fa133ef5-3c50-47da-a7ac-ca803314d8ed tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1321 microversion: 2.1 time: 0.157123 Nov 23 08:59:21.397436 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 57/124] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:21 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:21.546111 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-65a4cd00-9a17-4d7d-9861-d0fb37eb000b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:21.546793 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-65a4cd00-9a17-4d7d-9861-d0fb37eb000b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:21.553842 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-65a4cd00-9a17-4d7d-9861-d0fb37eb000b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:21.554411 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-65a4cd00-9a17-4d7d-9861-d0fb37eb000b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:21.555328 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-65a4cd00-9a17-4d7d-9861-d0fb37eb000b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:21.555878 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-65a4cd00-9a17-4d7d-9861-d0fb37eb000b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:21.690998 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-65a4cd00-9a17-4d7d-9861-d0fb37eb000b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:21.698764 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-65a4cd00-9a17-4d7d-9861-d0fb37eb000b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:21.700483 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-65a4cd00-9a17-4d7d-9861-d0fb37eb000b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:21.701587 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-65a4cd00-9a17-4d7d-9861-d0fb37eb000b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1407 microversion: 2.20 time: 0.159215 Nov 23 08:59:21.702151 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 68/125] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 08:59:21 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 08:59:22.407329 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-de3b29f3-c903-40d1-a8d1-102253274c72 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:22.408037 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-de3b29f3-c903-40d1-a8d1-102253274c72 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:22.416378 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-de3b29f3-c903-40d1-a8d1-102253274c72 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:22.416949 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-de3b29f3-c903-40d1-a8d1-102253274c72 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:22.417942 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-de3b29f3-c903-40d1-a8d1-102253274c72 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:22.418530 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-de3b29f3-c903-40d1-a8d1-102253274c72 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:22.652489 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-de3b29f3-c903-40d1-a8d1-102253274c72 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:22.672448 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-de3b29f3-c903-40d1-a8d1-102253274c72 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1514 microversion: 2.1 time: 0.269256 Nov 23 08:59:22.683481 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 58/126] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:22 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1514 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:22.691556 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-fbe8c506-21d6-4846-8bae-b725ff7eb6ee tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:22.693590 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-fbe8c506-21d6-4846-8bae-b725ff7eb6ee tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:22.702852 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-fbe8c506-21d6-4846-8bae-b725ff7eb6ee tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:22.703747 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-fbe8c506-21d6-4846-8bae-b725ff7eb6ee tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:22.704905 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-fbe8c506-21d6-4846-8bae-b725ff7eb6ee tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:22.705520 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-fbe8c506-21d6-4846-8bae-b725ff7eb6ee tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:22.721449 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-2cd5d927-29e5-4ebd-b91f-1831209b46c7 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:22.722042 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-2cd5d927-29e5-4ebd-b91f-1831209b46c7 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:22.731849 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2cd5d927-29e5-4ebd-b91f-1831209b46c7 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:22.732308 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2cd5d927-29e5-4ebd-b91f-1831209b46c7 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:22.733083 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2cd5d927-29e5-4ebd-b91f-1831209b46c7 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:22.733543 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2cd5d927-29e5-4ebd-b91f-1831209b46c7 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:22.741865 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.objects.instance [None req-fbe8c506-21d6-4846-8bae-b725ff7eb6ee tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lazy-loading 'flavor' on Instance uuid 7360d955-d8b0-49dc-bb7e-a804b8f5246b {{(pid=116227) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 08:59:22.961280 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-fbe8c506-21d6-4846-8bae-b725ff7eb6ee tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "POST /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b/action" status: 200 len: 32 microversion: 2.1 time: 0.274741 Nov 23 08:59:22.962666 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 69/127] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 08:59:22 2021] POST /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b/action => generated 32 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 08:59:22.972807 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-1e792ed8-c601-4ef0-aea4-0848a6f19ffa tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d96d8421-387e-473d-936e-f0ec5f6eddad"}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:22.974767 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-1e792ed8-c601-4ef0-aea4-0848a6f19ffa tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:22.985109 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1e792ed8-c601-4ef0-aea4-0848a6f19ffa tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:22.985933 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1e792ed8-c601-4ef0-aea4-0848a6f19ffa tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:22.987701 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1e792ed8-c601-4ef0-aea4-0848a6f19ffa tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:22.988231 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1e792ed8-c601-4ef0-aea4-0848a6f19ffa tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:23.002868 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-2cd5d927-29e5-4ebd-b91f-1831209b46c7 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:23.020828 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-2cd5d927-29e5-4ebd-b91f-1831209b46c7 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:23.022855 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-2cd5d927-29e5-4ebd-b91f-1831209b46c7 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:23.024172 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-2cd5d927-29e5-4ebd-b91f-1831209b46c7 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1407 microversion: 2.20 time: 0.308299 Nov 23 08:59:23.024945 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 59/128] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 08:59:22 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1407 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 08:59:23.030171 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-5261ddde-77a5-450d-a007-f53a9c7113cf tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:23.031284 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-5261ddde-77a5-450d-a007-f53a9c7113cf tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:23.052694 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5261ddde-77a5-450d-a007-f53a9c7113cf tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:23.066520 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5261ddde-77a5-450d-a007-f53a9c7113cf tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:23.068402 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5261ddde-77a5-450d-a007-f53a9c7113cf tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:23.069778 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5261ddde-77a5-450d-a007-f53a9c7113cf tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:23.384537 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-5261ddde-77a5-450d-a007-f53a9c7113cf tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:23.396830 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-5261ddde-77a5-450d-a007-f53a9c7113cf tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.370376 Nov 23 08:59:23.397824 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 60/129] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:23 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:23.630632 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-1e792ed8-c601-4ef0-aea4-0848a6f19ffa tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "POST /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.664590 Nov 23 08:59:23.631980 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 70/130] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 23 08:59:22 2021] POST /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39/os-volume_attachments => generated 194 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:59:24.042951 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e1e87a87-a404-45dd-96a7-23994e28bd7e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:24.043627 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e1e87a87-a404-45dd-96a7-23994e28bd7e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:24.050537 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e1e87a87-a404-45dd-96a7-23994e28bd7e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:24.050981 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e1e87a87-a404-45dd-96a7-23994e28bd7e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:24.051783 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e1e87a87-a404-45dd-96a7-23994e28bd7e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:24.052215 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e1e87a87-a404-45dd-96a7-23994e28bd7e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:24.194219 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-e1e87a87-a404-45dd-96a7-23994e28bd7e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:24.205944 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-e1e87a87-a404-45dd-96a7-23994e28bd7e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:24.208631 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-e1e87a87-a404-45dd-96a7-23994e28bd7e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:24.209964 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e1e87a87-a404-45dd-96a7-23994e28bd7e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1599 microversion: 2.20 time: 0.170620 Nov 23 08:59:24.210747 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 61/131] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 08:59:24 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1599 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 08:59:24.232020 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-df57dfbb-3bc2-42a1-84dc-20a4ef541bf4 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:24.232760 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-df57dfbb-3bc2-42a1-84dc-20a4ef541bf4 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:24.241908 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-df57dfbb-3bc2-42a1-84dc-20a4ef541bf4 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:24.242364 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-df57dfbb-3bc2-42a1-84dc-20a4ef541bf4 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:24.243469 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-df57dfbb-3bc2-42a1-84dc-20a4ef541bf4 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:24.244029 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-df57dfbb-3bc2-42a1-84dc-20a4ef541bf4 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:24.348718 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-df57dfbb-3bc2-42a1-84dc-20a4ef541bf4 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.121861 Nov 23 08:59:24.356146 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 71/132] 10.222.0.46 () {60 vars in 1315 bytes} [Tue Nov 23 08:59:24 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 08:59:24.415469 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-9b328d2e-d0c3-4ed9-ac85-c2136e679a8c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:24.416588 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-9b328d2e-d0c3-4ed9-ac85-c2136e679a8c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:24.423228 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9b328d2e-d0c3-4ed9-ac85-c2136e679a8c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:24.423781 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9b328d2e-d0c3-4ed9-ac85-c2136e679a8c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:24.424735 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9b328d2e-d0c3-4ed9-ac85-c2136e679a8c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:24.425194 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9b328d2e-d0c3-4ed9-ac85-c2136e679a8c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:24.580565 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-9b328d2e-d0c3-4ed9-ac85-c2136e679a8c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:24.588669 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-9b328d2e-d0c3-4ed9-ac85-c2136e679a8c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.176818 Nov 23 08:59:24.589278 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 62/133] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:24 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:25.024278 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-c7829f2f-2542-45a9-ab00-ec8844404c71 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1941917088", "imageRef": "18424a16-ac32-42d5-8161-d6cb36423de3", "flavorRef": "452", "networks": [{"uuid": "3885b5b6-3fad-407d-ad1a-570b02daaee7"}]}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:25.110690 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.network.neutron [None req-c7829f2f-2542-45a9-ab00-ec8844404c71 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] validate_networks() for [('3885b5b6-3fad-407d-ad1a-570b02daaee7', None, None, None, None, None)] {{(pid=116227) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 08:59:25.609040 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-0e1a0a55-c1a9-468b-b1c1-1df518e4d518 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:25.611180 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-0e1a0a55-c1a9-468b-b1c1-1df518e4d518 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:25.620532 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0e1a0a55-c1a9-468b-b1c1-1df518e4d518 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:25.621340 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0e1a0a55-c1a9-468b-b1c1-1df518e4d518 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:25.622394 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0e1a0a55-c1a9-468b-b1c1-1df518e4d518 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:25.622978 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0e1a0a55-c1a9-468b-b1c1-1df518e4d518 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:25.868326 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-0e1a0a55-c1a9-468b-b1c1-1df518e4d518 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:25.889535 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-0e1a0a55-c1a9-468b-b1c1-1df518e4d518 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.274486 Nov 23 08:59:25.890192 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 63/134] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:25 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:25.960592 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.virt.hardware [None req-c7829f2f-2542-45a9-ab00-ec8844404c71 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Flavor limits 0:0:0 {{(pid=116227) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 08:59:25.961078 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.virt.hardware [None req-c7829f2f-2542-45a9-ab00-ec8844404c71 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Image limits 0:0:0 {{(pid=116227) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 08:59:25.961497 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.virt.hardware [None req-c7829f2f-2542-45a9-ab00-ec8844404c71 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Flavor pref 0:0:0 {{(pid=116227) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 08:59:25.961905 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.virt.hardware [None req-c7829f2f-2542-45a9-ab00-ec8844404c71 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Image pref 0:0:0 {{(pid=116227) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 08:59:25.962310 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.virt.hardware [None req-c7829f2f-2542-45a9-ab00-ec8844404c71 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116227) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 08:59:25.983370 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c7829f2f-2542-45a9-ab00-ec8844404c71 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:25.983902 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c7829f2f-2542-45a9-ab00-ec8844404c71 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:25.985620 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c7829f2f-2542-45a9-ab00-ec8844404c71 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:25.986064 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c7829f2f-2542-45a9-ab00-ec8844404c71 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:26.026240 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.quota [None req-c7829f2f-2542-45a9-ab00-ec8844404c71 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Getting quotas for project cc96d46a97c943aca49c42bd6ba512a7. Resources: {'instances', 'ram', 'cores'} {{(pid=116227) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 08:59:26.039737 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.quota [None req-c7829f2f-2542-45a9-ab00-ec8844404c71 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Getting quotas for user 9aab4af24a784bd29062cfb1f27e37b8 and project cc96d46a97c943aca49c42bd6ba512a7. Resources: {'instances', 'ram', 'cores'} {{(pid=116227) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 08:59:26.056638 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-c7829f2f-2542-45a9-ab00-ec8844404c71 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Going to run 1 instances... {{(pid=116227) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 08:59:26.059578 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-c7829f2f-2542-45a9-ab00-ec8844404c71 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: 1b386ea7-77b5-48b4-a375-10966f3dd299] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='18424a16-ac32-42d5-8161-d6cb36423de3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116227) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 08:59:26.122560 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-c7829f2f-2542-45a9-ab00-ec8844404c71 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.102245 Nov 23 08:59:26.129080 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 72/135] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 23 08:59:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 1104 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 08:59:26.134086 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-ab79cafd-5901-401b-84ea-8c65c45a2128 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:26.134968 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-ab79cafd-5901-401b-84ea-8c65c45a2128 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: 1b386ea7-77b5-48b4-a375-10966f3dd299] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:26.209978 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-ab79cafd-5901-401b-84ea-8c65c45a2128 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:26.217548 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-ab79cafd-5901-401b-84ea-8c65c45a2128 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299" status: 200 len: 1219 microversion: 2.1 time: 0.086964 Nov 23 08:59:26.228422 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 64/136] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:26 2021] GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:26.353755 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-b6f19b25-09b7-4296-9b67-ac8060e88286 req-bd5923c2-4042-45f9-8bdb-98f01f947779 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82569d71-833c-454b-a668-12dc9a37e7e2", "tag": "efe7e8ac-f495-4361-902c-7da559e50715"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:26.355038 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-5b49ddfe-adf9-4d46-9b44-92502e99b788 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:26.355447 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 08:59:26.355447 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 08:59:26.359411 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-5b49ddfe-adf9-4d46-9b44-92502e99b788 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:26.364552 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-b6f19b25-09b7-4296-9b67-ac8060e88286 req-bd5923c2-4042-45f9-8bdb-98f01f947779 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:26.365288 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-b6f19b25-09b7-4296-9b67-ac8060e88286 req-bd5923c2-4042-45f9-8bdb-98f01f947779 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:26.387669 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5b49ddfe-adf9-4d46-9b44-92502e99b788 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:26.393727 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5b49ddfe-adf9-4d46-9b44-92502e99b788 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:26.396061 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-b6f19b25-09b7-4296-9b67-ac8060e88286 req-bd5923c2-4042-45f9-8bdb-98f01f947779 service nova] Creating event network-changed:efe7e8ac-f495-4361-902c-7da559e50715 for instance 82569d71-833c-454b-a668-12dc9a37e7e2 on hv-cinder-76845 Nov 23 08:59:26.396327 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5b49ddfe-adf9-4d46-9b44-92502e99b788 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:26.397397 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5b49ddfe-adf9-4d46-9b44-92502e99b788 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:26.402457 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-b6f19b25-09b7-4296-9b67-ac8060e88286 req-bd5923c2-4042-45f9-8bdb-98f01f947779 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052907 Nov 23 08:59:26.403531 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 65/137] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 08:59:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 08:59:26.509482 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-5b49ddfe-adf9-4d46-9b44-92502e99b788 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 14 microversion: 2.20 time: 0.160533 Nov 23 08:59:26.510310 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 73/138] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 08:59:26 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 14 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:26.908917 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-247aa25f-bec9-4377-b9d2-ff928cf267a4 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:26.909817 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-247aa25f-bec9-4377-b9d2-ff928cf267a4 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:26.921043 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-247aa25f-bec9-4377-b9d2-ff928cf267a4 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:26.922686 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-247aa25f-bec9-4377-b9d2-ff928cf267a4 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:26.932283 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-247aa25f-bec9-4377-b9d2-ff928cf267a4 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:26.933426 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-247aa25f-bec9-4377-b9d2-ff928cf267a4 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:27.146847 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-247aa25f-bec9-4377-b9d2-ff928cf267a4 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:27.159761 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-247aa25f-bec9-4377-b9d2-ff928cf267a4 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.254876 Nov 23 08:59:27.160760 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 66/139] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:26 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:27.239289 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-986d664f-91e9-416f-8d9d-ad39a93524ac tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:27.240425 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-986d664f-91e9-416f-8d9d-ad39a93524ac tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: 1b386ea7-77b5-48b4-a375-10966f3dd299] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:27.256386 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-986d664f-91e9-416f-8d9d-ad39a93524ac tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:27.261297 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-986d664f-91e9-416f-8d9d-ad39a93524ac tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:27.262849 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-986d664f-91e9-416f-8d9d-ad39a93524ac tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:27.266155 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-986d664f-91e9-416f-8d9d-ad39a93524ac tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:27.379327 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-986d664f-91e9-416f-8d9d-ad39a93524ac tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:27.402859 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-986d664f-91e9-416f-8d9d-ad39a93524ac tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299" status: 200 len: 1271 microversion: 2.1 time: 0.169928 Nov 23 08:59:27.408309 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 74/140] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:27 2021] GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299 => generated 1271 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:27.524188 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-90db47c7-c673-4358-ba21-881ec275885f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:27.528117 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-90db47c7-c673-4358-ba21-881ec275885f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:27.552980 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-90db47c7-c673-4358-ba21-881ec275885f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:27.552980 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-90db47c7-c673-4358-ba21-881ec275885f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:27.553462 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-90db47c7-c673-4358-ba21-881ec275885f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:27.554089 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-90db47c7-c673-4358-ba21-881ec275885f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:27.751150 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-90db47c7-c673-4358-ba21-881ec275885f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 14 microversion: 2.20 time: 0.232953 Nov 23 08:59:27.755040 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 67/141] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 08:59:27 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 14 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:28.178470 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-d225db90-b9bc-426e-9c98-3243bc6e1d37 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:28.178881 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-d225db90-b9bc-426e-9c98-3243bc6e1d37 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:28.191582 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d225db90-b9bc-426e-9c98-3243bc6e1d37 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:28.193689 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d225db90-b9bc-426e-9c98-3243bc6e1d37 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:28.197689 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d225db90-b9bc-426e-9c98-3243bc6e1d37 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:28.200502 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d225db90-b9bc-426e-9c98-3243bc6e1d37 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:28.430463 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-1597d32c-213a-4704-87f0-2d4e167f9712 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:28.431161 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-1597d32c-213a-4704-87f0-2d4e167f9712 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: 1b386ea7-77b5-48b4-a375-10966f3dd299] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:28.449411 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1597d32c-213a-4704-87f0-2d4e167f9712 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:28.452376 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1597d32c-213a-4704-87f0-2d4e167f9712 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:28.456553 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1597d32c-213a-4704-87f0-2d4e167f9712 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:28.457196 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1597d32c-213a-4704-87f0-2d4e167f9712 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:28.494222 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-d225db90-b9bc-426e-9c98-3243bc6e1d37 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:28.509923 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-d225db90-b9bc-426e-9c98-3243bc6e1d37 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.331834 Nov 23 08:59:28.510610 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 75/142] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:28 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:28.590388 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-1597d32c-213a-4704-87f0-2d4e167f9712 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:28.617890 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-1597d32c-213a-4704-87f0-2d4e167f9712 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299" status: 200 len: 1277 microversion: 2.1 time: 0.189056 Nov 23 08:59:28.630376 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 68/143] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:28 2021] GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299 => generated 1277 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:28.768394 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-d971a34a-d260-484c-ab59-d0afad0bad38 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:28.768394 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-d971a34a-d260-484c-ab59-d0afad0bad38 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:28.784825 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d971a34a-d260-484c-ab59-d0afad0bad38 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:28.785531 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d971a34a-d260-484c-ab59-d0afad0bad38 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:28.786908 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d971a34a-d260-484c-ab59-d0afad0bad38 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:28.787502 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d971a34a-d260-484c-ab59-d0afad0bad38 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:28.862886 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-d971a34a-d260-484c-ab59-d0afad0bad38 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 14 microversion: 2.20 time: 0.103680 Nov 23 08:59:28.863601 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 76/144] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 08:59:28 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:29.527437 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c1bfb8f4-f513-4a12-8455-740a04aa78f7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:29.528567 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c1bfb8f4-f513-4a12-8455-740a04aa78f7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:29.537196 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c1bfb8f4-f513-4a12-8455-740a04aa78f7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:29.537919 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c1bfb8f4-f513-4a12-8455-740a04aa78f7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:29.538731 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c1bfb8f4-f513-4a12-8455-740a04aa78f7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:29.539175 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c1bfb8f4-f513-4a12-8455-740a04aa78f7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:29.637398 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-91a1b0b2-ea32-493b-82ec-1f94f512902a tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:29.638135 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-91a1b0b2-ea32-493b-82ec-1f94f512902a tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: 1b386ea7-77b5-48b4-a375-10966f3dd299] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:29.649964 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-91a1b0b2-ea32-493b-82ec-1f94f512902a tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:29.651353 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-91a1b0b2-ea32-493b-82ec-1f94f512902a tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:29.652583 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-91a1b0b2-ea32-493b-82ec-1f94f512902a tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:29.653291 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-91a1b0b2-ea32-493b-82ec-1f94f512902a tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:29.697491 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-c1bfb8f4-f513-4a12-8455-740a04aa78f7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:29.706254 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c1bfb8f4-f513-4a12-8455-740a04aa78f7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.183540 Nov 23 08:59:29.706989 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 69/145] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:29 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:29.796347 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-5d0d7712-ad75-411e-820e-920c81b8afc0 req-679ed5d3-95bf-478a-89c5-3a1196d72f7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b386ea7-77b5-48b4-a375-10966f3dd299", "tag": "f11c5832-1be3-47ce-9fbb-7c5c32b35c5b"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:29.798487 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 08:59:29.798487 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 08:59:29.829254 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-5d0d7712-ad75-411e-820e-920c81b8afc0 req-679ed5d3-95bf-478a-89c5-3a1196d72f7f service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:29.831468 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-5d0d7712-ad75-411e-820e-920c81b8afc0 req-679ed5d3-95bf-478a-89c5-3a1196d72f7f service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:29.858241 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-5d0d7712-ad75-411e-820e-920c81b8afc0 req-679ed5d3-95bf-478a-89c5-3a1196d72f7f service nova] Creating event network-changed:f11c5832-1be3-47ce-9fbb-7c5c32b35c5b for instance 1b386ea7-77b5-48b4-a375-10966f3dd299 on hv-cinder-76845 Nov 23 08:59:29.870852 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-5d0d7712-ad75-411e-820e-920c81b8afc0 req-679ed5d3-95bf-478a-89c5-3a1196d72f7f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080736 Nov 23 08:59:29.874013 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 70/146] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 08:59:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:59:29.884598 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c850be23-7a23-41da-b24a-91b50a2fbfa3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:29.885892 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c850be23-7a23-41da-b24a-91b50a2fbfa3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:29.893553 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c850be23-7a23-41da-b24a-91b50a2fbfa3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:29.894260 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c850be23-7a23-41da-b24a-91b50a2fbfa3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:29.895705 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c850be23-7a23-41da-b24a-91b50a2fbfa3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:29.896360 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c850be23-7a23-41da-b24a-91b50a2fbfa3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:29.978716 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c850be23-7a23-41da-b24a-91b50a2fbfa3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 14 microversion: 2.20 time: 0.098726 Nov 23 08:59:29.979575 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 71/147] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 08:59:29 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:30.076746 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-91a1b0b2-ea32-493b-82ec-1f94f512902a tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:30.092419 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-91a1b0b2-ea32-493b-82ec-1f94f512902a tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299" status: 200 len: 1319 microversion: 2.1 time: 0.454183 Nov 23 08:59:30.107127 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 77/148] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:29 2021] GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299 => generated 1319 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:30.472990 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-894dee04-325e-4567-b61e-88a58eacc908 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-971357243", "imageRef": "18424a16-ac32-42d5-8161-d6cb36423de3", "flavorRef": "452", "networks": [{"uuid": "90165a93-ecd4-4624-b7b5-1b5c85ea25bb"}]}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:30.561854 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.network.neutron [None req-894dee04-325e-4567-b61e-88a58eacc908 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] validate_networks() for [('90165a93-ecd4-4624-b7b5-1b5c85ea25bb', None, None, None, None, None)] {{(pid=116226) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 08:59:30.724553 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-b8753490-d6db-404e-b715-820a4aae2e8b tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:30.725412 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-b8753490-d6db-404e-b715-820a4aae2e8b tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:30.733198 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b8753490-d6db-404e-b715-820a4aae2e8b tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:30.734675 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b8753490-d6db-404e-b715-820a4aae2e8b tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:30.736048 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b8753490-d6db-404e-b715-820a4aae2e8b tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:30.737959 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b8753490-d6db-404e-b715-820a4aae2e8b tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:30.997262 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-b8753490-d6db-404e-b715-820a4aae2e8b tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:31.010325 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-b8753490-d6db-404e-b715-820a4aae2e8b tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.290105 Nov 23 08:59:31.021781 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 78/149] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:30 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:31.027685 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-b1cc7c68-980e-4c37-a3a7-e0fdd5538817 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:31.028976 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-b1cc7c68-980e-4c37-a3a7-e0fdd5538817 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:31.035931 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b1cc7c68-980e-4c37-a3a7-e0fdd5538817 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:31.036593 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b1cc7c68-980e-4c37-a3a7-e0fdd5538817 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:31.037593 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b1cc7c68-980e-4c37-a3a7-e0fdd5538817 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:31.038179 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b1cc7c68-980e-4c37-a3a7-e0fdd5538817 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:31.106230 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-894dee04-325e-4567-b61e-88a58eacc908 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Flavor limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 08:59:31.107000 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-894dee04-325e-4567-b61e-88a58eacc908 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Image limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 08:59:31.108515 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-894dee04-325e-4567-b61e-88a58eacc908 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Flavor pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 08:59:31.109328 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-894dee04-325e-4567-b61e-88a58eacc908 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Image pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 08:59:31.110100 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-894dee04-325e-4567-b61e-88a58eacc908 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 08:59:31.120818 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-894dee04-325e-4567-b61e-88a58eacc908 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:31.122053 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-894dee04-325e-4567-b61e-88a58eacc908 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:31.123306 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-894dee04-325e-4567-b61e-88a58eacc908 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:31.123978 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-894dee04-325e-4567-b61e-88a58eacc908 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:31.138625 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-b1cc7c68-980e-4c37-a3a7-e0fdd5538817 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 14 microversion: 2.20 time: 0.115065 Nov 23 08:59:31.139969 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 79/150] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 08:59:31 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:31.144014 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-894dee04-325e-4567-b61e-88a58eacc908 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Getting quotas for project 82f534070f974dc882ad415be1a1d3ef. Resources: {'instances', 'ram', 'cores'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 08:59:31.146962 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-8e7519e2-9eae-4e6b-befe-95f2c01678e4 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:31.148850 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-894dee04-325e-4567-b61e-88a58eacc908 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Getting quotas for user 0642f1d3e0da400ebba9d029f63a95ce and project 82f534070f974dc882ad415be1a1d3ef. Resources: {'instances', 'ram', 'cores'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 08:59:31.149444 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-8e7519e2-9eae-4e6b-befe-95f2c01678e4 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: 1b386ea7-77b5-48b4-a375-10966f3dd299] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:31.163913 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-894dee04-325e-4567-b61e-88a58eacc908 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Going to run 1 instances... {{(pid=116226) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 08:59:31.166811 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-894dee04-325e-4567-b61e-88a58eacc908 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 3631a4c0-56e0-419b-8c2a-56dcbc6c0230] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='18424a16-ac32-42d5-8161-d6cb36423de3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116226) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 08:59:31.169199 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8e7519e2-9eae-4e6b-befe-95f2c01678e4 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:31.169842 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8e7519e2-9eae-4e6b-befe-95f2c01678e4 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:31.171840 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8e7519e2-9eae-4e6b-befe-95f2c01678e4 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:31.175370 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8e7519e2-9eae-4e6b-befe-95f2c01678e4 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:31.226371 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-894dee04-325e-4567-b61e-88a58eacc908 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.757706 Nov 23 08:59:31.227191 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 72/151] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 23 08:59:30 2021] POST /compute/v2.1/servers => generated 380 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 08:59:31.240240 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e537f5cb-dbf6-4dd5-b3b5-78d840da435a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:31.241228 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e537f5cb-dbf6-4dd5-b3b5-78d840da435a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 3631a4c0-56e0-419b-8c2a-56dcbc6c0230] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:31.318542 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-e537f5cb-dbf6-4dd5-b3b5-78d840da435a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:31.326832 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e537f5cb-dbf6-4dd5-b3b5-78d840da435a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230" status: 200 len: 1217 microversion: 2.1 time: 0.093040 Nov 23 08:59:31.330546 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 73/152] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:31 2021] GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230 => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:31.483769 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-8e7519e2-9eae-4e6b-befe-95f2c01678e4 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:31.493308 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-8e7519e2-9eae-4e6b-befe-95f2c01678e4 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299" status: 200 len: 1319 microversion: 2.1 time: 0.350895 Nov 23 08:59:31.494119 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 80/153] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:31 2021] GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299 => generated 1319 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:32.029646 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-910697dc-58dc-4bdb-8439-332c3547ad25 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:32.031646 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-910697dc-58dc-4bdb-8439-332c3547ad25 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:32.041791 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-910697dc-58dc-4bdb-8439-332c3547ad25 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:32.042442 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-910697dc-58dc-4bdb-8439-332c3547ad25 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:32.043969 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-910697dc-58dc-4bdb-8439-332c3547ad25 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:32.045014 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-910697dc-58dc-4bdb-8439-332c3547ad25 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:32.150791 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-182ba037-e6da-43d1-a193-12ad2397c436 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:32.152717 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-182ba037-e6da-43d1-a193-12ad2397c436 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:32.160093 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-182ba037-e6da-43d1-a193-12ad2397c436 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:32.160464 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-182ba037-e6da-43d1-a193-12ad2397c436 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:32.161282 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-182ba037-e6da-43d1-a193-12ad2397c436 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:32.161880 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-182ba037-e6da-43d1-a193-12ad2397c436 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:32.234666 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-910697dc-58dc-4bdb-8439-332c3547ad25 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:32.242391 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-910697dc-58dc-4bdb-8439-332c3547ad25 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.217321 Nov 23 08:59:32.252946 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 74/154] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:32 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:32.259332 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-182ba037-e6da-43d1-a193-12ad2397c436 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 14 microversion: 2.20 time: 0.112567 Nov 23 08:59:32.260051 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 81/155] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 08:59:32 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:32.354027 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a7b77a71-a839-482d-96f7-ee680c59097f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:32.354836 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a7b77a71-a839-482d-96f7-ee680c59097f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 3631a4c0-56e0-419b-8c2a-56dcbc6c0230] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:32.368177 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a7b77a71-a839-482d-96f7-ee680c59097f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:32.377486 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a7b77a71-a839-482d-96f7-ee680c59097f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:32.377486 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a7b77a71-a839-482d-96f7-ee680c59097f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:32.377486 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a7b77a71-a839-482d-96f7-ee680c59097f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:32.432184 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a7b77a71-a839-482d-96f7-ee680c59097f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:32.439576 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a7b77a71-a839-482d-96f7-ee680c59097f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230" status: 200 len: 1269 microversion: 2.1 time: 0.092086 Nov 23 08:59:32.440691 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 75/156] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:32 2021] GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230 => generated 1269 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:32.512457 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-04d54dcd-fc17-4582-ae4b-00b1ad662c4e tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:32.513775 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-04d54dcd-fc17-4582-ae4b-00b1ad662c4e tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: 1b386ea7-77b5-48b4-a375-10966f3dd299] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:32.524519 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-04d54dcd-fc17-4582-ae4b-00b1ad662c4e tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:32.525217 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-04d54dcd-fc17-4582-ae4b-00b1ad662c4e tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:32.526308 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-04d54dcd-fc17-4582-ae4b-00b1ad662c4e tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:32.526746 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-04d54dcd-fc17-4582-ae4b-00b1ad662c4e tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:32.955448 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-04d54dcd-fc17-4582-ae4b-00b1ad662c4e tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:32.964744 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-04d54dcd-fc17-4582-ae4b-00b1ad662c4e tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299" status: 200 len: 1319 microversion: 2.1 time: 0.457087 Nov 23 08:59:32.972470 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 82/157] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:32 2021] GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299 => generated 1319 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:33.261024 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-36bf3207-56f1-44f5-8db6-91b0ffd7be6c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:33.261674 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-36bf3207-56f1-44f5-8db6-91b0ffd7be6c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:33.269889 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-36bf3207-56f1-44f5-8db6-91b0ffd7be6c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:33.270368 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-36bf3207-56f1-44f5-8db6-91b0ffd7be6c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:33.271301 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-36bf3207-56f1-44f5-8db6-91b0ffd7be6c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:33.271900 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-36bf3207-56f1-44f5-8db6-91b0ffd7be6c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:33.272019 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-24cddf31-b0d7-4d48-8ffe-8ac23ab0ddef tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:33.272997 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-24cddf31-b0d7-4d48-8ffe-8ac23ab0ddef tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:33.280097 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-24cddf31-b0d7-4d48-8ffe-8ac23ab0ddef tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:33.280748 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-24cddf31-b0d7-4d48-8ffe-8ac23ab0ddef tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:33.281741 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-24cddf31-b0d7-4d48-8ffe-8ac23ab0ddef tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:33.282342 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-24cddf31-b0d7-4d48-8ffe-8ac23ab0ddef tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:33.352722 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-24cddf31-b0d7-4d48-8ffe-8ac23ab0ddef tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 14 microversion: 2.20 time: 0.084920 Nov 23 08:59:33.353432 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 83/158] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 08:59:33 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:33.436256 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-36bf3207-56f1-44f5-8db6-91b0ffd7be6c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:33.444550 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-36bf3207-56f1-44f5-8db6-91b0ffd7be6c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.187934 Nov 23 08:59:33.445387 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 76/159] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:33 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:33.458888 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-c4b2b5c1-63c3-4dfa-ae50-23a988e1346f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:33.459761 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-c4b2b5c1-63c3-4dfa-ae50-23a988e1346f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 3631a4c0-56e0-419b-8c2a-56dcbc6c0230] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:33.467472 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c4b2b5c1-63c3-4dfa-ae50-23a988e1346f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:33.468121 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c4b2b5c1-63c3-4dfa-ae50-23a988e1346f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:33.470551 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c4b2b5c1-63c3-4dfa-ae50-23a988e1346f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:33.470997 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c4b2b5c1-63c3-4dfa-ae50-23a988e1346f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:33.720756 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-c4b2b5c1-63c3-4dfa-ae50-23a988e1346f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:33.735548 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-c4b2b5c1-63c3-4dfa-ae50-23a988e1346f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230" status: 200 len: 1317 microversion: 2.1 time: 0.281230 Nov 23 08:59:33.741236 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 84/160] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:33 2021] GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230 => generated 1317 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:33.987924 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f80f040c-56ae-464f-93db-7b7be2fbb964 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:33.988545 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f80f040c-56ae-464f-93db-7b7be2fbb964 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: 1b386ea7-77b5-48b4-a375-10966f3dd299] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:33.995244 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f80f040c-56ae-464f-93db-7b7be2fbb964 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:33.996523 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f80f040c-56ae-464f-93db-7b7be2fbb964 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:33.997367 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f80f040c-56ae-464f-93db-7b7be2fbb964 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:33.997814 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f80f040c-56ae-464f-93db-7b7be2fbb964 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:34.166147 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-f80f040c-56ae-464f-93db-7b7be2fbb964 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:34.175383 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f80f040c-56ae-464f-93db-7b7be2fbb964 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299" status: 200 len: 1319 microversion: 2.1 time: 0.193414 Nov 23 08:59:34.176489 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 77/161] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:33 2021] GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299 => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:34.336867 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-593d05ff-4dba-4be1-9ef8-3c049852e4bf req-531325ff-2cd2-45c2-9a02-451d6459301f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3631a4c0-56e0-419b-8c2a-56dcbc6c0230", "tag": "cbdffd7c-afc7-47b2-9b90-e46f41e18a36"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:34.338522 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 08:59:34.338522 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 08:59:34.351106 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-593d05ff-4dba-4be1-9ef8-3c049852e4bf req-531325ff-2cd2-45c2-9a02-451d6459301f service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:34.351593 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-593d05ff-4dba-4be1-9ef8-3c049852e4bf req-531325ff-2cd2-45c2-9a02-451d6459301f service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:34.367921 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c83867a9-d811-4fe1-91f9-59ad934a8545 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:34.369148 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c83867a9-d811-4fe1-91f9-59ad934a8545 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:34.371509 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-593d05ff-4dba-4be1-9ef8-3c049852e4bf req-531325ff-2cd2-45c2-9a02-451d6459301f service nova] Creating event network-changed:cbdffd7c-afc7-47b2-9b90-e46f41e18a36 for instance 3631a4c0-56e0-419b-8c2a-56dcbc6c0230 on hv-cinder-76845 Nov 23 08:59:34.382371 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-593d05ff-4dba-4be1-9ef8-3c049852e4bf req-531325ff-2cd2-45c2-9a02-451d6459301f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047515 Nov 23 08:59:34.383374 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c83867a9-d811-4fe1-91f9-59ad934a8545 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:34.384126 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c83867a9-d811-4fe1-91f9-59ad934a8545 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:34.385261 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 85/162] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 08:59:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:59:34.401860 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c83867a9-d811-4fe1-91f9-59ad934a8545 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:34.402343 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c83867a9-d811-4fe1-91f9-59ad934a8545 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:34.463729 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-5ab01a0a-c75e-4cf5-81e6-e4d0e87a4507 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:34.464592 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-5ab01a0a-c75e-4cf5-81e6-e4d0e87a4507 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:34.475326 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5ab01a0a-c75e-4cf5-81e6-e4d0e87a4507 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:34.482217 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5ab01a0a-c75e-4cf5-81e6-e4d0e87a4507 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:34.483481 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5ab01a0a-c75e-4cf5-81e6-e4d0e87a4507 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:34.483967 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5ab01a0a-c75e-4cf5-81e6-e4d0e87a4507 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:34.508929 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c83867a9-d811-4fe1-91f9-59ad934a8545 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 14 microversion: 2.20 time: 0.146411 Nov 23 08:59:34.519260 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 78/163] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 08:59:34 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:34.754072 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e1687b81-baed-4479-9994-43ee412b2ead tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:34.754947 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e1687b81-baed-4479-9994-43ee412b2ead tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 3631a4c0-56e0-419b-8c2a-56dcbc6c0230] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:34.761795 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e1687b81-baed-4479-9994-43ee412b2ead tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:34.762323 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e1687b81-baed-4479-9994-43ee412b2ead tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:34.763198 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e1687b81-baed-4479-9994-43ee412b2ead tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:34.763705 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e1687b81-baed-4479-9994-43ee412b2ead tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:34.784586 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-5ab01a0a-c75e-4cf5-81e6-e4d0e87a4507 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:34.792934 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-5ab01a0a-c75e-4cf5-81e6-e4d0e87a4507 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.333528 Nov 23 08:59:34.793792 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 86/164] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:34 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:34.902400 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-e1687b81-baed-4479-9994-43ee412b2ead tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:34.910232 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e1687b81-baed-4479-9994-43ee412b2ead tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230" status: 200 len: 1317 microversion: 2.1 time: 0.160387 Nov 23 08:59:34.910957 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 79/165] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:34 2021] GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:35.192260 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-7d6a2a49-608f-4406-85cc-dedd01902515 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:35.192889 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-7d6a2a49-608f-4406-85cc-dedd01902515 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: 1b386ea7-77b5-48b4-a375-10966f3dd299] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:35.199209 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7d6a2a49-608f-4406-85cc-dedd01902515 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:35.199657 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7d6a2a49-608f-4406-85cc-dedd01902515 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:35.200430 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7d6a2a49-608f-4406-85cc-dedd01902515 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:35.200857 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7d6a2a49-608f-4406-85cc-dedd01902515 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:35.520946 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-bac40847-9268-4264-8169-60f89b4b432a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:35.522145 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-bac40847-9268-4264-8169-60f89b4b432a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:35.534441 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bac40847-9268-4264-8169-60f89b4b432a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:35.535029 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bac40847-9268-4264-8169-60f89b4b432a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:35.535990 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bac40847-9268-4264-8169-60f89b4b432a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:35.536750 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bac40847-9268-4264-8169-60f89b4b432a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:35.614998 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-bac40847-9268-4264-8169-60f89b4b432a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 14 microversion: 2.20 time: 0.097712 Nov 23 08:59:35.616546 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 80/166] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 08:59:35 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:35.626310 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-7b2b54a2-43b0-4676-b126-13c004eee349 req-904735a7-15ee-4721-99bb-bec6eeaf07c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b386ea7-77b5-48b4-a375-10966f3dd299", "name": "network-vif-plugged", "status": "completed", "tag": "f11c5832-1be3-47ce-9fbb-7c5c32b35c5b"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:35.628986 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 08:59:35.628986 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 08:59:35.630885 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-7d6a2a49-608f-4406-85cc-dedd01902515 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:35.641599 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-7d6a2a49-608f-4406-85cc-dedd01902515 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299" status: 200 len: 1319 microversion: 2.1 time: 0.452791 Nov 23 08:59:35.647734 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-7b2b54a2-43b0-4676-b126-13c004eee349 req-904735a7-15ee-4721-99bb-bec6eeaf07c6 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:35.648184 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-7b2b54a2-43b0-4676-b126-13c004eee349 req-904735a7-15ee-4721-99bb-bec6eeaf07c6 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:35.652189 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 87/167] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:35 2021] GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299 => generated 1319 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:35.664426 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-7b2b54a2-43b0-4676-b126-13c004eee349 req-904735a7-15ee-4721-99bb-bec6eeaf07c6 service nova] Creating event network-vif-plugged:f11c5832-1be3-47ce-9fbb-7c5c32b35c5b for instance 1b386ea7-77b5-48b4-a375-10966f3dd299 on hv-cinder-76845 Nov 23 08:59:35.678950 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-7b2b54a2-43b0-4676-b126-13c004eee349 req-904735a7-15ee-4721-99bb-bec6eeaf07c6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060570 Nov 23 08:59:35.679567 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 81/168] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 08:59:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:59:35.811826 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-a0c92b5a-eaa2-4c2e-9e53-f51ace831ab8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:35.812970 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-a0c92b5a-eaa2-4c2e-9e53-f51ace831ab8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:35.819992 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a0c92b5a-eaa2-4c2e-9e53-f51ace831ab8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:35.820701 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a0c92b5a-eaa2-4c2e-9e53-f51ace831ab8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:35.821657 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a0c92b5a-eaa2-4c2e-9e53-f51ace831ab8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:35.822202 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a0c92b5a-eaa2-4c2e-9e53-f51ace831ab8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:35.929136 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-de33cf0a-c0e5-438c-a059-38dec637d599 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:35.929855 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-de33cf0a-c0e5-438c-a059-38dec637d599 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 3631a4c0-56e0-419b-8c2a-56dcbc6c0230] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:35.949230 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-de33cf0a-c0e5-438c-a059-38dec637d599 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:35.950261 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-de33cf0a-c0e5-438c-a059-38dec637d599 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:35.955156 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-de33cf0a-c0e5-438c-a059-38dec637d599 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:35.955611 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-de33cf0a-c0e5-438c-a059-38dec637d599 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:36.174497 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-a0c92b5a-eaa2-4c2e-9e53-f51ace831ab8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:36.181772 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-a0c92b5a-eaa2-4c2e-9e53-f51ace831ab8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.373531 Nov 23 08:59:36.182392 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 88/169] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:35 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:36.208501 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-de33cf0a-c0e5-438c-a059-38dec637d599 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:36.216030 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-de33cf0a-c0e5-438c-a059-38dec637d599 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230" status: 200 len: 1317 microversion: 2.1 time: 0.291227 Nov 23 08:59:36.216793 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 82/170] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:35 2021] GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230 => generated 1317 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:36.626732 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-85f7256d-b724-47f5-a2a8-ce8a665f9e52 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:36.627637 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-85f7256d-b724-47f5-a2a8-ce8a665f9e52 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:36.634318 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-85f7256d-b724-47f5-a2a8-ce8a665f9e52 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:36.634986 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-85f7256d-b724-47f5-a2a8-ce8a665f9e52 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:36.635639 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-85f7256d-b724-47f5-a2a8-ce8a665f9e52 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:36.636072 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-85f7256d-b724-47f5-a2a8-ce8a665f9e52 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:36.660318 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-64cc5689-5380-4351-9736-fd0d38e31bce tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:36.660942 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-64cc5689-5380-4351-9736-fd0d38e31bce tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: 1b386ea7-77b5-48b4-a375-10966f3dd299] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:36.670261 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-64cc5689-5380-4351-9736-fd0d38e31bce tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:36.671049 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-64cc5689-5380-4351-9736-fd0d38e31bce tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:36.672481 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-64cc5689-5380-4351-9736-fd0d38e31bce tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:36.673226 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-64cc5689-5380-4351-9736-fd0d38e31bce tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:36.823488 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-64cc5689-5380-4351-9736-fd0d38e31bce tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:36.832077 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-64cc5689-5380-4351-9736-fd0d38e31bce tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299" status: 200 len: 1319 microversion: 2.1 time: 0.176444 Nov 23 08:59:36.833775 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 83/171] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:36 2021] GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:37.200406 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-76e13351-7051-4cd5-a47c-9306cf14f65e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:37.201132 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-76e13351-7051-4cd5-a47c-9306cf14f65e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:37.208614 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-76e13351-7051-4cd5-a47c-9306cf14f65e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:37.209067 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-76e13351-7051-4cd5-a47c-9306cf14f65e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:37.209883 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-76e13351-7051-4cd5-a47c-9306cf14f65e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:37.210321 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-76e13351-7051-4cd5-a47c-9306cf14f65e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:37.415552 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-76e13351-7051-4cd5-a47c-9306cf14f65e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:37.426293 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-76e13351-7051-4cd5-a47c-9306cf14f65e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.231056 Nov 23 08:59:37.427372 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 84/172] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:37 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:37.435426 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-35bdb91a-40a1-4c7f-8e0d-8bea00193965 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:37.436686 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-35bdb91a-40a1-4c7f-8e0d-8bea00193965 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 3631a4c0-56e0-419b-8c2a-56dcbc6c0230] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:37.443905 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-35bdb91a-40a1-4c7f-8e0d-8bea00193965 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:37.444486 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-35bdb91a-40a1-4c7f-8e0d-8bea00193965 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:37.445484 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-35bdb91a-40a1-4c7f-8e0d-8bea00193965 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:37.445996 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-35bdb91a-40a1-4c7f-8e0d-8bea00193965 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:37.591254 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-35bdb91a-40a1-4c7f-8e0d-8bea00193965 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:37.598852 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-35bdb91a-40a1-4c7f-8e0d-8bea00193965 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230" status: 200 len: 1317 microversion: 2.1 time: 0.170175 Nov 23 08:59:37.599426 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 85/173] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:37 2021] GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:37.849885 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-ad7805d3-cc50-4671-b266-fe6fd2fc247e tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:37.850658 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-ad7805d3-cc50-4671-b266-fe6fd2fc247e tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: 1b386ea7-77b5-48b4-a375-10966f3dd299] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:37.856625 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ad7805d3-cc50-4671-b266-fe6fd2fc247e tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:37.857072 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ad7805d3-cc50-4671-b266-fe6fd2fc247e tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:37.857880 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ad7805d3-cc50-4671-b266-fe6fd2fc247e tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:37.858312 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ad7805d3-cc50-4671-b266-fe6fd2fc247e tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:37.990833 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-ad7805d3-cc50-4671-b266-fe6fd2fc247e tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:37.998416 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-ad7805d3-cc50-4671-b266-fe6fd2fc247e tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299" status: 200 len: 1319 microversion: 2.1 time: 0.152163 Nov 23 08:59:37.998982 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 86/174] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:37 2021] GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:38.446616 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-10aeefff-6e03-4809-b763-0060d86575b1 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:38.447284 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-10aeefff-6e03-4809-b763-0060d86575b1 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:38.453621 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-10aeefff-6e03-4809-b763-0060d86575b1 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:38.454117 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-10aeefff-6e03-4809-b763-0060d86575b1 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:38.454887 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-10aeefff-6e03-4809-b763-0060d86575b1 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:38.455316 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-10aeefff-6e03-4809-b763-0060d86575b1 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:38.608090 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-10aeefff-6e03-4809-b763-0060d86575b1 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:38.615707 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-10aeefff-6e03-4809-b763-0060d86575b1 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.172690 Nov 23 08:59:38.616286 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 87/175] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:38 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:38.620404 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-9153756a-b222-4ae0-af4c-f4f6b7c0738f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:38.620991 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-9153756a-b222-4ae0-af4c-f4f6b7c0738f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 3631a4c0-56e0-419b-8c2a-56dcbc6c0230] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:38.627528 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9153756a-b222-4ae0-af4c-f4f6b7c0738f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:38.628050 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9153756a-b222-4ae0-af4c-f4f6b7c0738f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:38.628946 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9153756a-b222-4ae0-af4c-f4f6b7c0738f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:38.629610 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9153756a-b222-4ae0-af4c-f4f6b7c0738f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:38.758068 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-9153756a-b222-4ae0-af4c-f4f6b7c0738f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:38.765704 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-9153756a-b222-4ae0-af4c-f4f6b7c0738f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230" status: 200 len: 1317 microversion: 2.1 time: 0.147932 Nov 23 08:59:38.766292 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 88/176] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:38 2021] GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230 => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:39.016068 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e3f27833-a083-422c-b4e6-27fb9a39e1e3 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:39.016734 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e3f27833-a083-422c-b4e6-27fb9a39e1e3 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: 1b386ea7-77b5-48b4-a375-10966f3dd299] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:39.022838 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e3f27833-a083-422c-b4e6-27fb9a39e1e3 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:39.023322 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e3f27833-a083-422c-b4e6-27fb9a39e1e3 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:39.024086 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e3f27833-a083-422c-b4e6-27fb9a39e1e3 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:39.024518 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e3f27833-a083-422c-b4e6-27fb9a39e1e3 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:39.156133 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-e3f27833-a083-422c-b4e6-27fb9a39e1e3 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:39.163322 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e3f27833-a083-422c-b4e6-27fb9a39e1e3 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299" status: 200 len: 1319 microversion: 2.1 time: 0.151388 Nov 23 08:59:39.163896 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 89/177] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:39 2021] GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:39.632928 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-3e4faf43-9fe1-4516-8996-692bb935b7e0 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:39.633584 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-3e4faf43-9fe1-4516-8996-692bb935b7e0 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:39.639842 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3e4faf43-9fe1-4516-8996-692bb935b7e0 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:39.640999 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3e4faf43-9fe1-4516-8996-692bb935b7e0 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:39.641945 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3e4faf43-9fe1-4516-8996-692bb935b7e0 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:39.642378 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3e4faf43-9fe1-4516-8996-692bb935b7e0 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:39.769318 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-85f7256d-b724-47f5-a2a8-ce8a665f9e52 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 14 microversion: 2.20 time: 3.146206 Nov 23 08:59:39.770468 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 89/178] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 08:59:36 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 14 bytes in 3148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:39.777697 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-3e4faf43-9fe1-4516-8996-692bb935b7e0 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:39.785511 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-208a6116-aaf7-440e-a9c6-4065648284c2 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:39.786544 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-208a6116-aaf7-440e-a9c6-4065648284c2 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 3631a4c0-56e0-419b-8c2a-56dcbc6c0230] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:39.786665 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-3e4faf43-9fe1-4516-8996-692bb935b7e0 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.157332 Nov 23 08:59:39.787215 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 90/179] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:39 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:39.794240 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-208a6116-aaf7-440e-a9c6-4065648284c2 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:39.794597 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-208a6116-aaf7-440e-a9c6-4065648284c2 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:39.795384 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-208a6116-aaf7-440e-a9c6-4065648284c2 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:39.795834 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-208a6116-aaf7-440e-a9c6-4065648284c2 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:39.935591 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-208a6116-aaf7-440e-a9c6-4065648284c2 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:39.944275 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-208a6116-aaf7-440e-a9c6-4065648284c2 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230" status: 200 len: 1317 microversion: 2.1 time: 0.165147 Nov 23 08:59:39.944845 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 90/180] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:39 2021] GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:40.179291 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-0323ee2f-b288-4cb2-bbda-b979b5aa0e0a tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:40.179926 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-0323ee2f-b288-4cb2-bbda-b979b5aa0e0a tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: 1b386ea7-77b5-48b4-a375-10966f3dd299] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:40.185598 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0323ee2f-b288-4cb2-bbda-b979b5aa0e0a tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:40.186050 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0323ee2f-b288-4cb2-bbda-b979b5aa0e0a tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:40.186915 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0323ee2f-b288-4cb2-bbda-b979b5aa0e0a tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:40.187371 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0323ee2f-b288-4cb2-bbda-b979b5aa0e0a tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:40.331246 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-0323ee2f-b288-4cb2-bbda-b979b5aa0e0a tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:40.342207 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-0323ee2f-b288-4cb2-bbda-b979b5aa0e0a tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299" status: 200 len: 1319 microversion: 2.1 time: 0.166322 Nov 23 08:59:40.352350 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 91/181] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:40 2021] GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:40.780483 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-360749dd-41b3-4868-8a88-d13e4c38b7d8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:40.782030 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-360749dd-41b3-4868-8a88-d13e4c38b7d8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:40.788702 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-360749dd-41b3-4868-8a88-d13e4c38b7d8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:40.789153 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-360749dd-41b3-4868-8a88-d13e4c38b7d8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:40.789945 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-360749dd-41b3-4868-8a88-d13e4c38b7d8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:40.790578 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-360749dd-41b3-4868-8a88-d13e4c38b7d8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:40.803849 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-81a1a69f-523d-4d56-9cff-47c912449c24 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:40.804558 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-81a1a69f-523d-4d56-9cff-47c912449c24 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:40.815246 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-81a1a69f-523d-4d56-9cff-47c912449c24 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:40.815690 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-81a1a69f-523d-4d56-9cff-47c912449c24 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:40.817900 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-81a1a69f-523d-4d56-9cff-47c912449c24 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:40.821038 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-81a1a69f-523d-4d56-9cff-47c912449c24 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:40.955862 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-360749dd-41b3-4868-8a88-d13e4c38b7d8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 14 microversion: 2.20 time: 0.179337 Nov 23 08:59:40.959170 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 91/182] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 08:59:40 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 14 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:40.964658 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-e8b0c96b-bc70-49f0-ae4c-39cfb39bee8d tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:40.965381 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-e8b0c96b-bc70-49f0-ae4c-39cfb39bee8d tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 3631a4c0-56e0-419b-8c2a-56dcbc6c0230] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:40.973910 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e8b0c96b-bc70-49f0-ae4c-39cfb39bee8d tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:40.974633 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e8b0c96b-bc70-49f0-ae4c-39cfb39bee8d tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:40.975466 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e8b0c96b-bc70-49f0-ae4c-39cfb39bee8d tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:40.975899 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e8b0c96b-bc70-49f0-ae4c-39cfb39bee8d tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:41.017335 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-81a1a69f-523d-4d56-9cff-47c912449c24 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:41.027452 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-81a1a69f-523d-4d56-9cff-47c912449c24 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.227121 Nov 23 08:59:41.038753 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 92/183] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:40 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:41.079766 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-7dda048e-a5c7-47af-a06c-562eb3621a61 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:41.079937 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-7dda048e-a5c7-47af-a06c-562eb3621a61 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:41.086809 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7dda048e-a5c7-47af-a06c-562eb3621a61 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:41.087276 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7dda048e-a5c7-47af-a06c-562eb3621a61 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:41.088080 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7dda048e-a5c7-47af-a06c-562eb3621a61 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:41.088515 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7dda048e-a5c7-47af-a06c-562eb3621a61 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:41.116401 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-7dda048e-a5c7-47af-a06c-562eb3621a61 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Going to try to terminate instance {{(pid=116226) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 08:59:41.137519 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-e8b0c96b-bc70-49f0-ae4c-39cfb39bee8d tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:41.144927 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-e8b0c96b-bc70-49f0-ae4c-39cfb39bee8d tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230" status: 200 len: 1317 microversion: 2.1 time: 0.184643 Nov 23 08:59:41.145714 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 92/184] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:40 2021] GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230 => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:41.204411 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-7dda048e-a5c7-47af-a06c-562eb3621a61 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "DELETE /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39" status: 204 len: 0 microversion: 2.1 time: 0.128954 Nov 23 08:59:41.205095 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 93/185] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 23 08:59:41 2021] DELETE /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 23 08:59:41.212843 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-fb76516d-c507-4216-9f24-b8dfd6e6f1d7 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:41.213478 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-fb76516d-c507-4216-9f24-b8dfd6e6f1d7 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:41.219820 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-fb76516d-c507-4216-9f24-b8dfd6e6f1d7 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:41.220272 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-fb76516d-c507-4216-9f24-b8dfd6e6f1d7 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:41.221091 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-fb76516d-c507-4216-9f24-b8dfd6e6f1d7 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:41.221585 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-fb76516d-c507-4216-9f24-b8dfd6e6f1d7 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:41.354994 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-fb76516d-c507-4216-9f24-b8dfd6e6f1d7 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460e9ced9648454dabe601930a8321e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ccfb93758054da3a7ba7a802b01ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:41.360659 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-22d27f87-85e7-436e-be65-4efdf3163af5 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:41.361582 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-22d27f87-85e7-436e-be65-4efdf3163af5 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: 1b386ea7-77b5-48b4-a375-10966f3dd299] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:41.363272 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-fb76516d-c507-4216-9f24-b8dfd6e6f1d7 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39" status: 200 len: 1554 microversion: 2.1 time: 0.154102 Nov 23 08:59:41.363840 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 93/186] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:41 2021] GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:41.367903 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-22d27f87-85e7-436e-be65-4efdf3163af5 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:41.368294 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-22d27f87-85e7-436e-be65-4efdf3163af5 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:41.369109 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-22d27f87-85e7-436e-be65-4efdf3163af5 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:41.369644 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-22d27f87-85e7-436e-be65-4efdf3163af5 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:41.495471 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-22d27f87-85e7-436e-be65-4efdf3163af5 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:41.503054 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-22d27f87-85e7-436e-be65-4efdf3163af5 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299" status: 200 len: 1507 microversion: 2.1 time: 0.147058 Nov 23 08:59:41.503616 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 94/187] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:41 2021] GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299 => generated 1507 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:41.966508 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-99ca1295-1ef5-47f3-8240-ff89cd111e71 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:41.967435 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-99ca1295-1ef5-47f3-8240-ff89cd111e71 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:41.974844 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-99ca1295-1ef5-47f3-8240-ff89cd111e71 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:41.975352 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-99ca1295-1ef5-47f3-8240-ff89cd111e71 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:41.976122 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-99ca1295-1ef5-47f3-8240-ff89cd111e71 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:41.976555 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-99ca1295-1ef5-47f3-8240-ff89cd111e71 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:42.047071 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-0449cf4c-a917-4100-8659-9a21b73ccdba tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:42.047927 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-0449cf4c-a917-4100-8659-9a21b73ccdba tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:42.054148 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0449cf4c-a917-4100-8659-9a21b73ccdba tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:42.054679 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0449cf4c-a917-4100-8659-9a21b73ccdba tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:42.055548 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0449cf4c-a917-4100-8659-9a21b73ccdba tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:42.056035 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0449cf4c-a917-4100-8659-9a21b73ccdba tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:42.189345 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-0449cf4c-a917-4100-8659-9a21b73ccdba tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:42.196485 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-0449cf4c-a917-4100-8659-9a21b73ccdba tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.154092 Nov 23 08:59:42.197058 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 95/188] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:42 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:42.201237 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-4ffbaa1d-a4f0-4df3-9cf6-0b3e6079ca30 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:42.201835 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-4ffbaa1d-a4f0-4df3-9cf6-0b3e6079ca30 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 3631a4c0-56e0-419b-8c2a-56dcbc6c0230] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:42.207327 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4ffbaa1d-a4f0-4df3-9cf6-0b3e6079ca30 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:42.207874 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4ffbaa1d-a4f0-4df3-9cf6-0b3e6079ca30 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:42.208532 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4ffbaa1d-a4f0-4df3-9cf6-0b3e6079ca30 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:42.208971 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4ffbaa1d-a4f0-4df3-9cf6-0b3e6079ca30 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:42.339552 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-4ffbaa1d-a4f0-4df3-9cf6-0b3e6079ca30 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:42.346935 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-4ffbaa1d-a4f0-4df3-9cf6-0b3e6079ca30 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230" status: 200 len: 1317 microversion: 2.1 time: 0.148931 Nov 23 08:59:42.347497 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 96/189] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:42 2021] GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:42.380193 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e5c7103b-e3c7-4919-b307-b2c0dc65262f tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:42.380840 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e5c7103b-e3c7-4919-b307-b2c0dc65262f tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:42.386494 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e5c7103b-e3c7-4919-b307-b2c0dc65262f tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:42.386963 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e5c7103b-e3c7-4919-b307-b2c0dc65262f tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:42.387754 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e5c7103b-e3c7-4919-b307-b2c0dc65262f tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:42.388234 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e5c7103b-e3c7-4919-b307-b2c0dc65262f tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:42.517626 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-e5c7103b-e3c7-4919-b307-b2c0dc65262f tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460e9ced9648454dabe601930a8321e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ccfb93758054da3a7ba7a802b01ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:42.525274 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e5c7103b-e3c7-4919-b307-b2c0dc65262f tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39" status: 200 len: 1554 microversion: 2.1 time: 0.148431 Nov 23 08:59:42.525842 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 97/190] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:42 2021] GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39 => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:43.212864 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-3e7e2b86-3ed6-41e7-98ae-110ddc350838 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:43.213500 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-3e7e2b86-3ed6-41e7-98ae-110ddc350838 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:43.220523 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3e7e2b86-3ed6-41e7-98ae-110ddc350838 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:43.220971 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3e7e2b86-3ed6-41e7-98ae-110ddc350838 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:43.221806 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3e7e2b86-3ed6-41e7-98ae-110ddc350838 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:43.222246 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3e7e2b86-3ed6-41e7-98ae-110ddc350838 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:43.348656 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-3e7e2b86-3ed6-41e7-98ae-110ddc350838 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:43.355974 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-3e7e2b86-3ed6-41e7-98ae-110ddc350838 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.146652 Nov 23 08:59:43.356538 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 98/191] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:43 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:43.363706 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-0920997d-3eb1-4f95-93d1-5e3573b625e6 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:43.364328 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-0920997d-3eb1-4f95-93d1-5e3573b625e6 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 3631a4c0-56e0-419b-8c2a-56dcbc6c0230] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:43.369913 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0920997d-3eb1-4f95-93d1-5e3573b625e6 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:43.370381 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0920997d-3eb1-4f95-93d1-5e3573b625e6 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:43.371124 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0920997d-3eb1-4f95-93d1-5e3573b625e6 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:43.371552 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0920997d-3eb1-4f95-93d1-5e3573b625e6 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:43.496759 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-0920997d-3eb1-4f95-93d1-5e3573b625e6 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:43.503819 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-0920997d-3eb1-4f95-93d1-5e3573b625e6 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230" status: 200 len: 1317 microversion: 2.1 time: 0.143764 Nov 23 08:59:43.504387 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 99/192] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:43 2021] GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230 => generated 1317 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:43.541481 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-17103610-8611-4dd7-9810-f6e6875475ba tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:43.542069 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-17103610-8611-4dd7-9810-f6e6875475ba tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:43.548172 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-17103610-8611-4dd7-9810-f6e6875475ba tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:43.548619 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-17103610-8611-4dd7-9810-f6e6875475ba tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:43.549420 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-17103610-8611-4dd7-9810-f6e6875475ba tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:43.549854 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-17103610-8611-4dd7-9810-f6e6875475ba tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:43.678911 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-17103610-8611-4dd7-9810-f6e6875475ba tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460e9ced9648454dabe601930a8321e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ccfb93758054da3a7ba7a802b01ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:43.686558 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-17103610-8611-4dd7-9810-f6e6875475ba tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39" status: 200 len: 1554 microversion: 2.1 time: 0.148353 Nov 23 08:59:43.688039 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 100/193] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:43 2021] GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:44.373117 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-24347911-ef28-4c69-92a8-ffc57c0da4fe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:44.373778 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-24347911-ef28-4c69-92a8-ffc57c0da4fe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:44.380621 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-24347911-ef28-4c69-92a8-ffc57c0da4fe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:44.381071 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-24347911-ef28-4c69-92a8-ffc57c0da4fe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:44.381882 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-24347911-ef28-4c69-92a8-ffc57c0da4fe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:44.382316 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-24347911-ef28-4c69-92a8-ffc57c0da4fe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:44.510622 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-24347911-ef28-4c69-92a8-ffc57c0da4fe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:44.518108 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-24347911-ef28-4c69-92a8-ffc57c0da4fe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.149045 Nov 23 08:59:44.518679 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 101/194] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:44 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:44.523768 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-43e95e0e-8df3-424e-a9f1-aed4e56203a0 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:44.524369 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-43e95e0e-8df3-424e-a9f1-aed4e56203a0 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 3631a4c0-56e0-419b-8c2a-56dcbc6c0230] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:44.530943 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-43e95e0e-8df3-424e-a9f1-aed4e56203a0 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:44.531405 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-43e95e0e-8df3-424e-a9f1-aed4e56203a0 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:44.532218 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-43e95e0e-8df3-424e-a9f1-aed4e56203a0 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:44.532644 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-43e95e0e-8df3-424e-a9f1-aed4e56203a0 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:44.630826 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-99ca1295-1ef5-47f3-8240-ff89cd111e71 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 6695 microversion: 2.20 time: 2.667215 Nov 23 08:59:44.634464 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 94/195] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 08:59:41 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 6695 bytes in 2672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 08:59:44.668304 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-43e95e0e-8df3-424e-a9f1-aed4e56203a0 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:44.676680 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-43e95e0e-8df3-424e-a9f1-aed4e56203a0 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230" status: 200 len: 1317 microversion: 2.1 time: 0.156880 Nov 23 08:59:44.677268 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 102/196] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:44 2021] GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:44.704502 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-32b71762-959c-408e-8b3a-aa7ceb6e19b6 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:44.705226 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-32b71762-959c-408e-8b3a-aa7ceb6e19b6 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:44.712272 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-32b71762-959c-408e-8b3a-aa7ceb6e19b6 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:44.712748 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-32b71762-959c-408e-8b3a-aa7ceb6e19b6 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:44.713548 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-32b71762-959c-408e-8b3a-aa7ceb6e19b6 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:44.714019 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-32b71762-959c-408e-8b3a-aa7ceb6e19b6 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:44.853112 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-32b71762-959c-408e-8b3a-aa7ceb6e19b6 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460e9ced9648454dabe601930a8321e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ccfb93758054da3a7ba7a802b01ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:44.861464 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-32b71762-959c-408e-8b3a-aa7ceb6e19b6 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39" status: 200 len: 1554 microversion: 2.1 time: 0.161545 Nov 23 08:59:44.862147 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 95/197] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:44 2021] GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:45.535136 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-16979a99-de0a-4ba8-b0f2-04616515241f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:45.535782 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-16979a99-de0a-4ba8-b0f2-04616515241f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:45.542003 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-16979a99-de0a-4ba8-b0f2-04616515241f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:45.542459 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-16979a99-de0a-4ba8-b0f2-04616515241f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:45.543242 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-16979a99-de0a-4ba8-b0f2-04616515241f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:45.543680 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-16979a99-de0a-4ba8-b0f2-04616515241f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:45.642496 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-cef87d61-e4e5-4b9c-ad73-10381346fdcb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:45.643560 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-cef87d61-e4e5-4b9c-ad73-10381346fdcb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:45.650068 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-cef87d61-e4e5-4b9c-ad73-10381346fdcb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:45.650597 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-cef87d61-e4e5-4b9c-ad73-10381346fdcb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:45.651447 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-cef87d61-e4e5-4b9c-ad73-10381346fdcb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:45.651797 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-cef87d61-e4e5-4b9c-ad73-10381346fdcb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:45.676879 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-16979a99-de0a-4ba8-b0f2-04616515241f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:45.684318 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-16979a99-de0a-4ba8-b0f2-04616515241f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.153290 Nov 23 08:59:45.684891 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 103/198] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:45 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:45.693265 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-3431e20f-b53c-4a40-926b-50a2d7887937 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:45.693865 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-3431e20f-b53c-4a40-926b-50a2d7887937 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 3631a4c0-56e0-419b-8c2a-56dcbc6c0230] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:45.699750 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3431e20f-b53c-4a40-926b-50a2d7887937 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:45.700203 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3431e20f-b53c-4a40-926b-50a2d7887937 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:45.700990 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3431e20f-b53c-4a40-926b-50a2d7887937 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:45.701449 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3431e20f-b53c-4a40-926b-50a2d7887937 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:45.834454 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-3431e20f-b53c-4a40-926b-50a2d7887937 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:45.841748 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-3431e20f-b53c-4a40-926b-50a2d7887937 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230" status: 200 len: 1317 microversion: 2.1 time: 0.151880 Nov 23 08:59:45.842315 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 104/199] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:45 2021] GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:45.878429 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-3e90e7a1-8834-400f-a76e-c5a026faa2f0 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:45.879030 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-3e90e7a1-8834-400f-a76e-c5a026faa2f0 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:45.885018 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3e90e7a1-8834-400f-a76e-c5a026faa2f0 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:45.885505 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3e90e7a1-8834-400f-a76e-c5a026faa2f0 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:45.886283 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3e90e7a1-8834-400f-a76e-c5a026faa2f0 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:45.886722 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3e90e7a1-8834-400f-a76e-c5a026faa2f0 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:46.023171 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-3e90e7a1-8834-400f-a76e-c5a026faa2f0 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460e9ced9648454dabe601930a8321e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ccfb93758054da3a7ba7a802b01ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:46.031726 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-3e90e7a1-8834-400f-a76e-c5a026faa2f0 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39" status: 200 len: 1554 microversion: 2.1 time: 0.156916 Nov 23 08:59:46.032290 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 105/200] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:45 2021] GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:46.659461 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-f034b3d4-b3fd-48bd-9f8b-24b5864bf02b req-3218df7c-d594-44fc-81f0-b35cd6ef57e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3631a4c0-56e0-419b-8c2a-56dcbc6c0230", "name": "network-vif-plugged", "status": "completed", "tag": "cbdffd7c-afc7-47b2-9b90-e46f41e18a36"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:46.661126 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 08:59:46.661126 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 08:59:46.668722 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-f034b3d4-b3fd-48bd-9f8b-24b5864bf02b req-3218df7c-d594-44fc-81f0-b35cd6ef57e8 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:46.669269 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-f034b3d4-b3fd-48bd-9f8b-24b5864bf02b req-3218df7c-d594-44fc-81f0-b35cd6ef57e8 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:46.682885 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-f034b3d4-b3fd-48bd-9f8b-24b5864bf02b req-3218df7c-d594-44fc-81f0-b35cd6ef57e8 service nova] Creating event network-vif-plugged:cbdffd7c-afc7-47b2-9b90-e46f41e18a36 for instance 3631a4c0-56e0-419b-8c2a-56dcbc6c0230 on hv-cinder-76845 Nov 23 08:59:46.688500 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-f034b3d4-b3fd-48bd-9f8b-24b5864bf02b req-3218df7c-d594-44fc-81f0-b35cd6ef57e8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032971 Nov 23 08:59:46.689130 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 106/201] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 08:59:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 08:59:46.701527 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f5b967a6-6e9e-44da-9f4a-0eaeca0b769e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:46.702207 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f5b967a6-6e9e-44da-9f4a-0eaeca0b769e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:46.708829 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f5b967a6-6e9e-44da-9f4a-0eaeca0b769e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:46.709312 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f5b967a6-6e9e-44da-9f4a-0eaeca0b769e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:46.710080 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f5b967a6-6e9e-44da-9f4a-0eaeca0b769e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:46.710509 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f5b967a6-6e9e-44da-9f4a-0eaeca0b769e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:46.842453 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-f5b967a6-6e9e-44da-9f4a-0eaeca0b769e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:46.850407 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f5b967a6-6e9e-44da-9f4a-0eaeca0b769e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.152665 Nov 23 08:59:46.850978 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 107/202] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:46 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:46.859281 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-4a93c657-97c2-4c9a-8573-5e2fc8b22bda tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:46.859874 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-4a93c657-97c2-4c9a-8573-5e2fc8b22bda tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 3631a4c0-56e0-419b-8c2a-56dcbc6c0230] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:46.865310 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4a93c657-97c2-4c9a-8573-5e2fc8b22bda tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:46.865758 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4a93c657-97c2-4c9a-8573-5e2fc8b22bda tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:46.866523 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4a93c657-97c2-4c9a-8573-5e2fc8b22bda tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:46.866951 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4a93c657-97c2-4c9a-8573-5e2fc8b22bda tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:46.998399 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-4a93c657-97c2-4c9a-8573-5e2fc8b22bda tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:47.005969 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-4a93c657-97c2-4c9a-8573-5e2fc8b22bda tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230" status: 200 len: 1317 microversion: 2.1 time: 0.150283 Nov 23 08:59:47.006540 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 108/203] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:46 2021] GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:47.049436 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-95399fb6-10ab-44cd-8268-564f158d6b4d tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:47.050038 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-95399fb6-10ab-44cd-8268-564f158d6b4d tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:47.055708 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-95399fb6-10ab-44cd-8268-564f158d6b4d tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:47.056157 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-95399fb6-10ab-44cd-8268-564f158d6b4d tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:47.056925 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-95399fb6-10ab-44cd-8268-564f158d6b4d tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:47.057391 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-95399fb6-10ab-44cd-8268-564f158d6b4d tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:47.188052 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-95399fb6-10ab-44cd-8268-564f158d6b4d tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460e9ced9648454dabe601930a8321e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ccfb93758054da3a7ba7a802b01ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:47.196160 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-95399fb6-10ab-44cd-8268-564f158d6b4d tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39" status: 200 len: 1554 microversion: 2.1 time: 0.150811 Nov 23 08:59:47.196736 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 109/204] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:47 2021] GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:47.866246 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-0fbdd240-88be-4e97-ab7c-f19499093efc tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:47.866921 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-0fbdd240-88be-4e97-ab7c-f19499093efc tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:47.873122 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0fbdd240-88be-4e97-ab7c-f19499093efc tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:47.873609 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0fbdd240-88be-4e97-ab7c-f19499093efc tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:47.874920 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0fbdd240-88be-4e97-ab7c-f19499093efc tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:47.875362 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0fbdd240-88be-4e97-ab7c-f19499093efc tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:48.004653 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-0fbdd240-88be-4e97-ab7c-f19499093efc tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:48.012015 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-0fbdd240-88be-4e97-ab7c-f19499093efc tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.149370 Nov 23 08:59:48.012590 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 110/205] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:47 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:48.022026 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-0cfcf567-e0bf-4edb-a4e5-dcf966771344 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:48.022622 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-0cfcf567-e0bf-4edb-a4e5-dcf966771344 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 3631a4c0-56e0-419b-8c2a-56dcbc6c0230] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:48.028104 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0cfcf567-e0bf-4edb-a4e5-dcf966771344 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:48.028549 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0cfcf567-e0bf-4edb-a4e5-dcf966771344 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:48.029353 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0cfcf567-e0bf-4edb-a4e5-dcf966771344 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:48.029791 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0cfcf567-e0bf-4edb-a4e5-dcf966771344 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:48.157082 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-0cfcf567-e0bf-4edb-a4e5-dcf966771344 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:48.165742 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-0cfcf567-e0bf-4edb-a4e5-dcf966771344 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230" status: 200 len: 1317 microversion: 2.1 time: 0.146791 Nov 23 08:59:48.166256 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 111/206] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:48 2021] GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230 => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:48.214040 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a61fffea-2d38-4781-b415-e916f4de2d55 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:48.214681 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a61fffea-2d38-4781-b415-e916f4de2d55 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:48.221427 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a61fffea-2d38-4781-b415-e916f4de2d55 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:48.221884 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a61fffea-2d38-4781-b415-e916f4de2d55 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:48.222661 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a61fffea-2d38-4781-b415-e916f4de2d55 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:48.223100 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a61fffea-2d38-4781-b415-e916f4de2d55 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:48.350622 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a61fffea-2d38-4781-b415-e916f4de2d55 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460e9ced9648454dabe601930a8321e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ccfb93758054da3a7ba7a802b01ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:48.358316 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a61fffea-2d38-4781-b415-e916f4de2d55 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39" status: 200 len: 1554 microversion: 2.1 time: 0.147891 Nov 23 08:59:48.359582 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 112/207] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:48 2021] GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:48.658173 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-cef87d61-e4e5-4b9c-ad73-10381346fdcb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 17602 microversion: 2.20 time: 3.019810 Nov 23 08:59:48.659114 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 96/208] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 08:59:45 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 17602 bytes in 3022 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 08:59:49.029148 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a632ec58-2719-4baa-9cc7-898c9bcc91c2 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:49.029781 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a632ec58-2719-4baa-9cc7-898c9bcc91c2 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:49.036335 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a632ec58-2719-4baa-9cc7-898c9bcc91c2 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:49.036782 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a632ec58-2719-4baa-9cc7-898c9bcc91c2 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:49.037581 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a632ec58-2719-4baa-9cc7-898c9bcc91c2 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:49.038051 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a632ec58-2719-4baa-9cc7-898c9bcc91c2 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:49.184752 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-5e06814b-a949-4717-b81b-226674f488d6 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:49.185020 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a632ec58-2719-4baa-9cc7-898c9bcc91c2 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:49.188768 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-5e06814b-a949-4717-b81b-226674f488d6 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 3631a4c0-56e0-419b-8c2a-56dcbc6c0230] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:49.200976 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5e06814b-a949-4717-b81b-226674f488d6 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:49.201460 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5e06814b-a949-4717-b81b-226674f488d6 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:49.202823 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5e06814b-a949-4717-b81b-226674f488d6 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:49.203265 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5e06814b-a949-4717-b81b-226674f488d6 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:49.207688 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a632ec58-2719-4baa-9cc7-898c9bcc91c2 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.182223 Nov 23 08:59:49.208452 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 113/209] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:49 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:49.378191 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-6495bd16-47d3-4a56-97c8-4d286b886b76 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:49.379266 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-6495bd16-47d3-4a56-97c8-4d286b886b76 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:49.387705 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6495bd16-47d3-4a56-97c8-4d286b886b76 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:49.388478 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6495bd16-47d3-4a56-97c8-4d286b886b76 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:49.390712 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6495bd16-47d3-4a56-97c8-4d286b886b76 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:49.391832 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6495bd16-47d3-4a56-97c8-4d286b886b76 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:49.471123 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-5e06814b-a949-4717-b81b-226674f488d6 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:49.480023 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-5e06814b-a949-4717-b81b-226674f488d6 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230" status: 200 len: 1317 microversion: 2.1 time: 0.299228 Nov 23 08:59:49.481278 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 97/210] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:49 2021] GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230 => generated 1317 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:49.558394 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-6495bd16-47d3-4a56-97c8-4d286b886b76 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460e9ced9648454dabe601930a8321e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ccfb93758054da3a7ba7a802b01ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:49.569026 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-6495bd16-47d3-4a56-97c8-4d286b886b76 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39" status: 200 len: 1554 microversion: 2.1 time: 0.196723 Nov 23 08:59:49.569954 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 114/211] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:49 2021] GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39 => generated 1554 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:49.669939 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-850e7fea-a2fc-44f6-86e1-fc4ce99656a8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:49.671818 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-850e7fea-a2fc-44f6-86e1-fc4ce99656a8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:49.678988 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-850e7fea-a2fc-44f6-86e1-fc4ce99656a8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:49.679450 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-850e7fea-a2fc-44f6-86e1-fc4ce99656a8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:49.680234 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-850e7fea-a2fc-44f6-86e1-fc4ce99656a8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:49.680707 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-850e7fea-a2fc-44f6-86e1-fc4ce99656a8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:50.227581 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-36549acb-5523-42be-abab-1ddbb3ccf8d6 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:50.234175 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-36549acb-5523-42be-abab-1ddbb3ccf8d6 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:50.242313 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-36549acb-5523-42be-abab-1ddbb3ccf8d6 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:50.243163 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-36549acb-5523-42be-abab-1ddbb3ccf8d6 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:50.244300 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-36549acb-5523-42be-abab-1ddbb3ccf8d6 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:50.244895 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-36549acb-5523-42be-abab-1ddbb3ccf8d6 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:50.423250 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-36549acb-5523-42be-abab-1ddbb3ccf8d6 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:50.431017 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-36549acb-5523-42be-abab-1ddbb3ccf8d6 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.208771 Nov 23 08:59:50.431908 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 115/212] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:50 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:50.496442 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b0391de6-101a-471f-87d0-d05eb697cc56 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:50.497145 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b0391de6-101a-471f-87d0-d05eb697cc56 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 3631a4c0-56e0-419b-8c2a-56dcbc6c0230] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:50.504693 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b0391de6-101a-471f-87d0-d05eb697cc56 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:50.504994 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b0391de6-101a-471f-87d0-d05eb697cc56 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:50.505844 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b0391de6-101a-471f-87d0-d05eb697cc56 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:50.506277 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b0391de6-101a-471f-87d0-d05eb697cc56 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:50.639520 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b0391de6-101a-471f-87d0-d05eb697cc56 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:50.647000 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b0391de6-101a-471f-87d0-d05eb697cc56 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230" status: 200 len: 1317 microversion: 2.1 time: 0.154247 Nov 23 08:59:50.647681 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 116/213] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:50 2021] GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:50.651831 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-31edd9fa-daec-443f-85c6-3cf0af47b220 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:50.652428 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-31edd9fa-daec-443f-85c6-3cf0af47b220 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:50.658054 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-31edd9fa-daec-443f-85c6-3cf0af47b220 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:50.658508 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-31edd9fa-daec-443f-85c6-3cf0af47b220 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:50.659280 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-31edd9fa-daec-443f-85c6-3cf0af47b220 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:50.659714 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-31edd9fa-daec-443f-85c6-3cf0af47b220 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:50.789720 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-31edd9fa-daec-443f-85c6-3cf0af47b220 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460e9ced9648454dabe601930a8321e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ccfb93758054da3a7ba7a802b01ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:50.798398 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-31edd9fa-daec-443f-85c6-3cf0af47b220 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39" status: 200 len: 1554 microversion: 2.1 time: 0.149769 Nov 23 08:59:50.798969 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 117/214] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:50 2021] GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:51.447824 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-db8346c5-9695-4990-a2c0-3d01843cf739 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:51.448431 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-db8346c5-9695-4990-a2c0-3d01843cf739 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:51.454690 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-db8346c5-9695-4990-a2c0-3d01843cf739 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:51.455138 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-db8346c5-9695-4990-a2c0-3d01843cf739 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:51.455943 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-db8346c5-9695-4990-a2c0-3d01843cf739 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:51.456379 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-db8346c5-9695-4990-a2c0-3d01843cf739 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:51.588951 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-db8346c5-9695-4990-a2c0-3d01843cf739 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:51.597211 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-db8346c5-9695-4990-a2c0-3d01843cf739 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.153059 Nov 23 08:59:51.597796 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 118/215] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:51 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:51.663365 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d6cb805a-ea15-4f03-b3c6-06052b219e95 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:51.663889 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d6cb805a-ea15-4f03-b3c6-06052b219e95 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 3631a4c0-56e0-419b-8c2a-56dcbc6c0230] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:51.669535 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d6cb805a-ea15-4f03-b3c6-06052b219e95 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:51.669982 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d6cb805a-ea15-4f03-b3c6-06052b219e95 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:51.670760 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d6cb805a-ea15-4f03-b3c6-06052b219e95 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:51.671877 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d6cb805a-ea15-4f03-b3c6-06052b219e95 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:51.802481 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d6cb805a-ea15-4f03-b3c6-06052b219e95 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:51.809751 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d6cb805a-ea15-4f03-b3c6-06052b219e95 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230" status: 200 len: 1317 microversion: 2.1 time: 0.149851 Nov 23 08:59:51.819776 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 119/216] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:51 2021] GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:51.819776 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-87a4cd96-8f0f-48a3-8d54-9b8f9e95a63f tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:51.819776 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-87a4cd96-8f0f-48a3-8d54-9b8f9e95a63f tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:51.822163 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-87a4cd96-8f0f-48a3-8d54-9b8f9e95a63f tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:51.822626 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-87a4cd96-8f0f-48a3-8d54-9b8f9e95a63f tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:51.823584 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-87a4cd96-8f0f-48a3-8d54-9b8f9e95a63f tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:51.824156 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-87a4cd96-8f0f-48a3-8d54-9b8f9e95a63f tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:51.967317 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-87a4cd96-8f0f-48a3-8d54-9b8f9e95a63f tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460e9ced9648454dabe601930a8321e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ccfb93758054da3a7ba7a802b01ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:51.975895 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-87a4cd96-8f0f-48a3-8d54-9b8f9e95a63f tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39" status: 200 len: 1554 microversion: 2.1 time: 0.164489 Nov 23 08:59:51.976474 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 120/217] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:51 2021] GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39 => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:52.614811 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-57dc12db-9b72-4430-ac35-732f4cb47b24 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:52.615474 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-57dc12db-9b72-4430-ac35-732f4cb47b24 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:52.621628 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-57dc12db-9b72-4430-ac35-732f4cb47b24 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:52.622084 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-57dc12db-9b72-4430-ac35-732f4cb47b24 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:52.622860 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-57dc12db-9b72-4430-ac35-732f4cb47b24 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:52.623302 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-57dc12db-9b72-4430-ac35-732f4cb47b24 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:52.748827 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-57dc12db-9b72-4430-ac35-732f4cb47b24 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:52.756225 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-57dc12db-9b72-4430-ac35-732f4cb47b24 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.145120 Nov 23 08:59:52.756803 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 121/218] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:52 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:52.826224 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b94cae8e-49ca-4873-89b5-f432e62c2161 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:52.826224 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b94cae8e-49ca-4873-89b5-f432e62c2161 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 3631a4c0-56e0-419b-8c2a-56dcbc6c0230] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:52.832566 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b94cae8e-49ca-4873-89b5-f432e62c2161 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:52.833015 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b94cae8e-49ca-4873-89b5-f432e62c2161 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:52.833823 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b94cae8e-49ca-4873-89b5-f432e62c2161 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:52.834283 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b94cae8e-49ca-4873-89b5-f432e62c2161 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:52.873197 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-850e7fea-a2fc-44f6-86e1-fc4ce99656a8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 21934 microversion: 2.20 time: 3.206570 Nov 23 08:59:52.877630 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 98/219] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 08:59:49 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 21934 bytes in 3209 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 08:59:52.964552 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b94cae8e-49ca-4873-89b5-f432e62c2161 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:52.972651 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b94cae8e-49ca-4873-89b5-f432e62c2161 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230" status: 200 len: 1317 microversion: 2.1 time: 0.150183 Nov 23 08:59:52.973237 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 122/220] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:52 2021] GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:52.994174 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-dd1faef2-1584-4a60-b832-31c88f60acff tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:52.995000 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-dd1faef2-1584-4a60-b832-31c88f60acff tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:53.002699 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-dd1faef2-1584-4a60-b832-31c88f60acff tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:53.003144 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-dd1faef2-1584-4a60-b832-31c88f60acff tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:53.004143 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-dd1faef2-1584-4a60-b832-31c88f60acff tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:53.004581 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-dd1faef2-1584-4a60-b832-31c88f60acff tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:53.134115 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-dd1faef2-1584-4a60-b832-31c88f60acff tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460e9ced9648454dabe601930a8321e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ccfb93758054da3a7ba7a802b01ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:53.142883 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-dd1faef2-1584-4a60-b832-31c88f60acff tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39" status: 200 len: 1554 microversion: 2.1 time: 0.153086 Nov 23 08:59:53.143455 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 99/221] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:52 2021] GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:53.773578 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-3dda7ac0-cde8-4106-890f-65d539e861e9 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:53.774190 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-3dda7ac0-cde8-4106-890f-65d539e861e9 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:53.781827 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3dda7ac0-cde8-4106-890f-65d539e861e9 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:53.781827 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3dda7ac0-cde8-4106-890f-65d539e861e9 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:53.782541 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3dda7ac0-cde8-4106-890f-65d539e861e9 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:53.782979 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3dda7ac0-cde8-4106-890f-65d539e861e9 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:53.885603 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-4c5d9ae3-32a5-4f89-a2b7-d318bb2e4904 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:53.887116 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-4c5d9ae3-32a5-4f89-a2b7-d318bb2e4904 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:53.897193 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4c5d9ae3-32a5-4f89-a2b7-d318bb2e4904 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:53.897712 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4c5d9ae3-32a5-4f89-a2b7-d318bb2e4904 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:53.898578 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4c5d9ae3-32a5-4f89-a2b7-d318bb2e4904 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:53.899086 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4c5d9ae3-32a5-4f89-a2b7-d318bb2e4904 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:53.951819 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-3dda7ac0-cde8-4106-890f-65d539e861e9 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:53.961011 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-3dda7ac0-cde8-4106-890f-65d539e861e9 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.191030 Nov 23 08:59:53.962125 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 123/222] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:53 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:53.990440 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-65a7105a-c21e-40db-97f4-a1ccc5f27f73 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:53.990987 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-65a7105a-c21e-40db-97f4-a1ccc5f27f73 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 3631a4c0-56e0-419b-8c2a-56dcbc6c0230] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:53.998146 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-65a7105a-c21e-40db-97f4-a1ccc5f27f73 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:53.998146 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-65a7105a-c21e-40db-97f4-a1ccc5f27f73 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:53.998436 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-65a7105a-c21e-40db-97f4-a1ccc5f27f73 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:53.998871 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-65a7105a-c21e-40db-97f4-a1ccc5f27f73 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:54.041569 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-4c5d9ae3-32a5-4f89-a2b7-d318bb2e4904 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 22767 microversion: 2.20 time: 0.159807 Nov 23 08:59:54.042213 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 100/223] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 08:59:53 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 22767 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 08:59:54.143854 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-65a7105a-c21e-40db-97f4-a1ccc5f27f73 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:54.151451 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-65a7105a-c21e-40db-97f4-a1ccc5f27f73 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230" status: 200 len: 1506 microversion: 2.1 time: 0.164732 Nov 23 08:59:54.152027 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 124/224] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:53 2021] GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:54.164309 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-758caeca-c872-471e-81d8-1b481b1efe95 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:54.164309 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-758caeca-c872-471e-81d8-1b481b1efe95 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:54.168981 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-2860c510-dc0d-4709-b0fe-957c9cd3ec64 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "753a654c-d630-486c-8138-695c56b389e2"}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:54.170341 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-2860c510-dc0d-4709-b0fe-957c9cd3ec64 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 3631a4c0-56e0-419b-8c2a-56dcbc6c0230] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:54.171592 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-758caeca-c872-471e-81d8-1b481b1efe95 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:54.172148 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-758caeca-c872-471e-81d8-1b481b1efe95 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:54.173050 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-758caeca-c872-471e-81d8-1b481b1efe95 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:54.173613 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-758caeca-c872-471e-81d8-1b481b1efe95 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:54.178242 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2860c510-dc0d-4709-b0fe-957c9cd3ec64 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:54.178897 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2860c510-dc0d-4709-b0fe-957c9cd3ec64 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:54.179883 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2860c510-dc0d-4709-b0fe-957c9cd3ec64 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:54.180502 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2860c510-dc0d-4709-b0fe-957c9cd3ec64 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:54.267040 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-2860c510-dc0d-4709-b0fe-957c9cd3ec64 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] HTTP exception thrown: Invalid volume: volume 753a654c-d630-486c-8138-695c56b389e2 is already attached to instances: 0f78026a-3a7c-46df-bc8b-8cf227c87354 Nov 23 08:59:54.267665 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-2860c510-dc0d-4709-b0fe-957c9cd3ec64 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Returning 400 to user: Invalid volume: volume 753a654c-d630-486c-8138-695c56b389e2 is already attached to instances: 0f78026a-3a7c-46df-bc8b-8cf227c87354 {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 08:59:54.268491 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-2860c510-dc0d-4709-b0fe-957c9cd3ec64 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "POST /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103403 Nov 23 08:59:54.269043 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 125/225] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 23 08:59:54 2021] POST /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 23 08:59:54.325484 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-758caeca-c872-471e-81d8-1b481b1efe95 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460e9ced9648454dabe601930a8321e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ccfb93758054da3a7ba7a802b01ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:54.328956 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-010dcaf1-398a-4f15-915f-5652df104bb6 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:54.329485 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-010dcaf1-398a-4f15-915f-5652df104bb6 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 0f78026a-3a7c-46df-bc8b-8cf227c87354] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:54.333647 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-758caeca-c872-471e-81d8-1b481b1efe95 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39" status: 200 len: 1554 microversion: 2.1 time: 0.176095 Nov 23 08:59:54.334425 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 101/226] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:54 2021] GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39 => generated 1554 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:54.337941 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-010dcaf1-398a-4f15-915f-5652df104bb6 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:54.339266 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-010dcaf1-398a-4f15-915f-5652df104bb6 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:54.340278 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-010dcaf1-398a-4f15-915f-5652df104bb6 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:54.340926 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-010dcaf1-398a-4f15-915f-5652df104bb6 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:54.476947 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.objects.instance [None req-010dcaf1-398a-4f15-915f-5652df104bb6 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lazy-loading 'services' on Instance uuid 0f78026a-3a7c-46df-bc8b-8cf227c87354 {{(pid=116226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 08:59:54.673909 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-010dcaf1-398a-4f15-915f-5652df104bb6 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354/os-volume_attachments/753a654c-d630-486c-8138-695c56b389e2" status: 202 len: 0 microversion: 2.1 time: 0.348785 Nov 23 08:59:54.677184 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 126/227] 10.222.0.46 () {58 vars in 1415 bytes} [Tue Nov 23 08:59:54 2021] DELETE /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354/os-volume_attachments/753a654c-d630-486c-8138-695c56b389e2 => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 08:59:54.685064 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-b17c12ba-19c7-477b-a238-aecbcb53a262 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:54.688796 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-b17c12ba-19c7-477b-a238-aecbcb53a262 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 0f78026a-3a7c-46df-bc8b-8cf227c87354] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:54.709055 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b17c12ba-19c7-477b-a238-aecbcb53a262 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:54.711786 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b17c12ba-19c7-477b-a238-aecbcb53a262 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:54.714055 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b17c12ba-19c7-477b-a238-aecbcb53a262 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:54.714500 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b17c12ba-19c7-477b-a238-aecbcb53a262 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:54.757082 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-b17c12ba-19c7-477b-a238-aecbcb53a262 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075610 Nov 23 08:59:54.757714 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 102/228] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 23 08:59:54 2021] GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:59:54.984473 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-1c6f557c-2e13-45cd-92ef-b427dde1e898 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:54.986383 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-1c6f557c-2e13-45cd-92ef-b427dde1e898 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:55.004318 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1c6f557c-2e13-45cd-92ef-b427dde1e898 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:55.005474 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1c6f557c-2e13-45cd-92ef-b427dde1e898 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:55.007369 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1c6f557c-2e13-45cd-92ef-b427dde1e898 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:55.008275 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1c6f557c-2e13-45cd-92ef-b427dde1e898 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:55.052618 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-ba029025-dcfe-44c5-bf69-b9da6147f1c8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:55.053662 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-ba029025-dcfe-44c5-bf69-b9da6147f1c8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:55.060670 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ba029025-dcfe-44c5-bf69-b9da6147f1c8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:55.066871 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ba029025-dcfe-44c5-bf69-b9da6147f1c8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:55.069989 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ba029025-dcfe-44c5-bf69-b9da6147f1c8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:55.070570 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ba029025-dcfe-44c5-bf69-b9da6147f1c8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:55.207065 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-1c6f557c-2e13-45cd-92ef-b427dde1e898 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:55.215287 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-1c6f557c-2e13-45cd-92ef-b427dde1e898 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.239236 Nov 23 08:59:55.216607 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 127/229] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:54 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:55.222234 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-ba029025-dcfe-44c5-bf69-b9da6147f1c8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 23796 microversion: 2.20 time: 0.172918 Nov 23 08:59:55.222778 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-b5e841d2-0973-4858-a8e6-b14f8909a90b req-de67e64f-ee27-4dfe-9f9c-f504b2df976c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60d6e5d5-d743-4b20-9b13-602e635d1c39", "name": "network-vif-deleted", "tag": "d6b7a840-3e22-4af8-ae32-3c470529acca"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:55.228352 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 103/230] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 08:59:55 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 23796 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 08:59:55.229209 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 08:59:55.229209 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 08:59:55.238861 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-b5e841d2-0973-4858-a8e6-b14f8909a90b req-de67e64f-ee27-4dfe-9f9c-f504b2df976c service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:55.239503 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-b5e841d2-0973-4858-a8e6-b14f8909a90b req-de67e64f-ee27-4dfe-9f9c-f504b2df976c service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:55.254783 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-b5e841d2-0973-4858-a8e6-b14f8909a90b req-de67e64f-ee27-4dfe-9f9c-f504b2df976c service nova] Creating event network-vif-deleted:d6b7a840-3e22-4af8-ae32-3c470529acca for instance 60d6e5d5-d743-4b20-9b13-602e635d1c39 on hv-cinder-76845 Nov 23 08:59:55.272797 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-b5e841d2-0973-4858-a8e6-b14f8909a90b req-de67e64f-ee27-4dfe-9f9c-f504b2df976c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054612 Nov 23 08:59:55.273766 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 128/231] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 08:59:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:59:55.351040 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-60454747-3f6f-4612-994b-0946d83fd97d tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:55.352025 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-60454747-3f6f-4612-994b-0946d83fd97d tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:55.361066 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-60454747-3f6f-4612-994b-0946d83fd97d tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:55.362308 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-60454747-3f6f-4612-994b-0946d83fd97d tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:55.363274 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-60454747-3f6f-4612-994b-0946d83fd97d tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:55.363726 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-60454747-3f6f-4612-994b-0946d83fd97d tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:55.444454 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-60454747-3f6f-4612-994b-0946d83fd97d tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460e9ced9648454dabe601930a8321e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ccfb93758054da3a7ba7a802b01ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:55.454044 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-60454747-3f6f-4612-994b-0946d83fd97d tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39" status: 200 len: 1346 microversion: 2.1 time: 0.106799 Nov 23 08:59:55.454917 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 104/232] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:55 2021] GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39 => generated 1346 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:55.768878 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-ecd661bf-9611-4870-9bf4-5eb84ed8db4f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:55.769965 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-ecd661bf-9611-4870-9bf4-5eb84ed8db4f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 0f78026a-3a7c-46df-bc8b-8cf227c87354] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:55.776031 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ecd661bf-9611-4870-9bf4-5eb84ed8db4f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:55.776492 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ecd661bf-9611-4870-9bf4-5eb84ed8db4f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:55.777316 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ecd661bf-9611-4870-9bf4-5eb84ed8db4f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:55.777937 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ecd661bf-9611-4870-9bf4-5eb84ed8db4f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:55.809649 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-ecd661bf-9611-4870-9bf4-5eb84ed8db4f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045261 Nov 23 08:59:55.810175 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 129/233] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 23 08:59:55 2021] GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 08:59:56.234721 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-efbfb105-4f9f-4ab3-89ee-5a0c33beb4ad tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:56.235735 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-51a715ad-8f98-4d8d-82b4-235ee95da461 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:56.236201 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-efbfb105-4f9f-4ab3-89ee-5a0c33beb4ad tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:56.236825 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-51a715ad-8f98-4d8d-82b4-235ee95da461 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:56.242444 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-efbfb105-4f9f-4ab3-89ee-5a0c33beb4ad tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:56.243122 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-efbfb105-4f9f-4ab3-89ee-5a0c33beb4ad tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:56.244316 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-efbfb105-4f9f-4ab3-89ee-5a0c33beb4ad tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:56.244911 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-efbfb105-4f9f-4ab3-89ee-5a0c33beb4ad tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:56.245356 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-51a715ad-8f98-4d8d-82b4-235ee95da461 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:56.245860 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-51a715ad-8f98-4d8d-82b4-235ee95da461 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:56.247368 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-51a715ad-8f98-4d8d-82b4-235ee95da461 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:56.248486 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-51a715ad-8f98-4d8d-82b4-235ee95da461 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:56.348205 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-efbfb105-4f9f-4ab3-89ee-5a0c33beb4ad tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 24338 microversion: 2.20 time: 0.117014 Nov 23 08:59:56.348982 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 130/234] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 08:59:56 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 24338 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 08:59:56.407783 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-51a715ad-8f98-4d8d-82b4-235ee95da461 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:56.415638 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-51a715ad-8f98-4d8d-82b4-235ee95da461 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.186043 Nov 23 08:59:56.426255 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 105/235] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:56 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:56.472766 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-aaefd9a8-9d68-4d70-89d8-afc3479a1340 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:56.473509 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-aaefd9a8-9d68-4d70-89d8-afc3479a1340 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:56.480503 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-aaefd9a8-9d68-4d70-89d8-afc3479a1340 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:56.480954 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-aaefd9a8-9d68-4d70-89d8-afc3479a1340 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:56.481771 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-aaefd9a8-9d68-4d70-89d8-afc3479a1340 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:56.482216 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-aaefd9a8-9d68-4d70-89d8-afc3479a1340 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:56.496892 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-aaefd9a8-9d68-4d70-89d8-afc3479a1340 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] HTTP exception thrown: Instance 60d6e5d5-d743-4b20-9b13-602e635d1c39 could not be found. Nov 23 08:59:56.497518 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-aaefd9a8-9d68-4d70-89d8-afc3479a1340 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Returning 404 to user: Instance 60d6e5d5-d743-4b20-9b13-602e635d1c39 could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 08:59:56.498344 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-aaefd9a8-9d68-4d70-89d8-afc3479a1340 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39" status: 404 len: 111 microversion: 2.1 time: 0.030740 Nov 23 08:59:56.498975 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 131/236] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:56 2021] GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 08:59:56.602201 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-7eca86ac-918d-4800-a3d9-7a92ac55daba tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:56.602996 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-7eca86ac-918d-4800-a3d9-7a92ac55daba tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:56.609506 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7eca86ac-918d-4800-a3d9-7a92ac55daba tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:56.609889 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7eca86ac-918d-4800-a3d9-7a92ac55daba tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:56.610665 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7eca86ac-918d-4800-a3d9-7a92ac55daba tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:56.611104 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7eca86ac-918d-4800-a3d9-7a92ac55daba tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:56.625236 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.wsgi [None req-7eca86ac-918d-4800-a3d9-7a92ac55daba tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] HTTP exception thrown: Instance 60d6e5d5-d743-4b20-9b13-602e635d1c39 could not be found. Nov 23 08:59:56.626010 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-7eca86ac-918d-4800-a3d9-7a92ac55daba tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Returning 404 to user: Instance 60d6e5d5-d743-4b20-9b13-602e635d1c39 could not be found. {{(pid=116227) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 08:59:56.626846 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-7eca86ac-918d-4800-a3d9-7a92ac55daba tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.028706 Nov 23 08:59:56.627406 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 106/237] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 23 08:59:56 2021] GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39/os-volume_attachments => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 08:59:56.821415 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-5f17e37b-65f4-481c-a8f7-a576cac82ff3 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:56.822455 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-5f17e37b-65f4-481c-a8f7-a576cac82ff3 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 0f78026a-3a7c-46df-bc8b-8cf227c87354] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:56.831001 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5f17e37b-65f4-481c-a8f7-a576cac82ff3 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:56.831458 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5f17e37b-65f4-481c-a8f7-a576cac82ff3 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:56.832248 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5f17e37b-65f4-481c-a8f7-a576cac82ff3 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:56.832693 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5f17e37b-65f4-481c-a8f7-a576cac82ff3 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:56.867647 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-5f17e37b-65f4-481c-a8f7-a576cac82ff3 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049954 Nov 23 08:59:56.868502 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 132/238] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 23 08:59:56 2021] GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 08:59:57.178390 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-71953552-413e-4214-8050-7dc724d65770 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1600837741", "imageRef": "18424a16-ac32-42d5-8161-d6cb36423de3", "flavorRef": "452", "networks": [{"uuid": "90165a93-ecd4-4624-b7b5-1b5c85ea25bb"}]}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:57.236127 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.network.neutron [None req-71953552-413e-4214-8050-7dc724d65770 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] validate_networks() for [('90165a93-ecd4-4624-b7b5-1b5c85ea25bb', None, None, None, None, None)] {{(pid=116227) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 08:59:57.364913 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-7afce1e7-617f-4119-9062-86c3e56be3a4 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:57.365988 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-7afce1e7-617f-4119-9062-86c3e56be3a4 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:57.372222 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7afce1e7-617f-4119-9062-86c3e56be3a4 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:57.372674 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7afce1e7-617f-4119-9062-86c3e56be3a4 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:57.373485 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7afce1e7-617f-4119-9062-86c3e56be3a4 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:57.374018 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7afce1e7-617f-4119-9062-86c3e56be3a4 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:57.483640 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-7afce1e7-617f-4119-9062-86c3e56be3a4 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 24908 microversion: 2.20 time: 0.127043 Nov 23 08:59:57.484380 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 133/239] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 08:59:57 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 24908 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 08:59:57.490293 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-86e4bf10-797b-48d4-8fd3-000c57a0bbd6 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:57.491037 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-86e4bf10-797b-48d4-8fd3-000c57a0bbd6 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:57.498185 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-86e4bf10-797b-48d4-8fd3-000c57a0bbd6 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:57.499192 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-86e4bf10-797b-48d4-8fd3-000c57a0bbd6 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:57.500311 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-86e4bf10-797b-48d4-8fd3-000c57a0bbd6 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:57.500911 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-86e4bf10-797b-48d4-8fd3-000c57a0bbd6 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:57.638217 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-86e4bf10-797b-48d4-8fd3-000c57a0bbd6 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:57.644713 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.virt.hardware [None req-71953552-413e-4214-8050-7dc724d65770 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Flavor limits 0:0:0 {{(pid=116227) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 08:59:57.645133 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.virt.hardware [None req-71953552-413e-4214-8050-7dc724d65770 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Image limits 0:0:0 {{(pid=116227) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 08:59:57.645668 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.virt.hardware [None req-71953552-413e-4214-8050-7dc724d65770 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Flavor pref 0:0:0 {{(pid=116227) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 08:59:57.646071 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.virt.hardware [None req-71953552-413e-4214-8050-7dc724d65770 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Image pref 0:0:0 {{(pid=116227) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 08:59:57.646476 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.virt.hardware [None req-71953552-413e-4214-8050-7dc724d65770 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116227) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 08:59:57.646896 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-86e4bf10-797b-48d4-8fd3-000c57a0bbd6 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.161174 Nov 23 08:59:57.647483 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 134/240] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:57 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:57.655532 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-71953552-413e-4214-8050-7dc724d65770 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:57.656060 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-71953552-413e-4214-8050-7dc724d65770 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:57.656896 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-71953552-413e-4214-8050-7dc724d65770 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:57.657425 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-71953552-413e-4214-8050-7dc724d65770 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:57.673785 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.quota [None req-71953552-413e-4214-8050-7dc724d65770 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Getting quotas for project 82f534070f974dc882ad415be1a1d3ef. Resources: {'instances', 'ram', 'cores'} {{(pid=116227) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 08:59:57.677577 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.quota [None req-71953552-413e-4214-8050-7dc724d65770 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Getting quotas for user 0642f1d3e0da400ebba9d029f63a95ce and project 82f534070f974dc882ad415be1a1d3ef. Resources: {'instances', 'ram', 'cores'} {{(pid=116227) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 08:59:57.688787 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-71953552-413e-4214-8050-7dc724d65770 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Going to run 1 instances... {{(pid=116227) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 08:59:57.691126 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-71953552-413e-4214-8050-7dc724d65770 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 280ce860-8611-44bc-9aa5-0409d2e36937] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='18424a16-ac32-42d5-8161-d6cb36423de3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116227) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 08:59:57.739342 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-71953552-413e-4214-8050-7dc724d65770 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.564503 Nov 23 08:59:57.745314 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 107/241] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 23 08:59:57 2021] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 08:59:57.750217 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-75b7d2ab-dacd-4821-92ec-2baa67dfda47 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:57.751176 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-75b7d2ab-dacd-4821-92ec-2baa67dfda47 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 280ce860-8611-44bc-9aa5-0409d2e36937] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:57.819023 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-75b7d2ab-dacd-4821-92ec-2baa67dfda47 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:57.828412 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-75b7d2ab-dacd-4821-92ec-2baa67dfda47 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937" status: 200 len: 1218 microversion: 2.1 time: 0.082098 Nov 23 08:59:57.829749 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 135/242] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:57 2021] GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:57.833006 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-73169d74-a6bb-40fc-a070-be3e00794196 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:57.833542 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-73169d74-a6bb-40fc-a070-be3e00794196 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:57.841866 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-73169d74-a6bb-40fc-a070-be3e00794196 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:57.842316 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-73169d74-a6bb-40fc-a070-be3e00794196 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:57.843140 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-73169d74-a6bb-40fc-a070-be3e00794196 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:57.844004 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-73169d74-a6bb-40fc-a070-be3e00794196 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:57.858889 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.wsgi [None req-73169d74-a6bb-40fc-a070-be3e00794196 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] HTTP exception thrown: Instance 60d6e5d5-d743-4b20-9b13-602e635d1c39 could not be found. Nov 23 08:59:57.859549 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-73169d74-a6bb-40fc-a070-be3e00794196 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Returning 404 to user: Instance 60d6e5d5-d743-4b20-9b13-602e635d1c39 could not be found. {{(pid=116227) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 08:59:57.860367 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-73169d74-a6bb-40fc-a070-be3e00794196 tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "DELETE /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39" status: 404 len: 111 microversion: 2.1 time: 0.036104 Nov 23 08:59:57.860927 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 108/243] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 23 08:59:57 2021] DELETE /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 08:59:57.869379 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-793b2f1c-347b-456e-9fce-cf438f5efd9c tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:57.870251 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-793b2f1c-347b-456e-9fce-cf438f5efd9c tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] [instance: 60d6e5d5-d743-4b20-9b13-602e635d1c39] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:57.877804 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-793b2f1c-347b-456e-9fce-cf438f5efd9c tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:57.878466 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-793b2f1c-347b-456e-9fce-cf438f5efd9c tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:57.879261 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-793b2f1c-347b-456e-9fce-cf438f5efd9c tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:57.879732 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-793b2f1c-347b-456e-9fce-cf438f5efd9c tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:57.894246 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-793b2f1c-347b-456e-9fce-cf438f5efd9c tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] HTTP exception thrown: Instance 60d6e5d5-d743-4b20-9b13-602e635d1c39 could not be found. Nov 23 08:59:57.894869 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-793b2f1c-347b-456e-9fce-cf438f5efd9c tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] Returning 404 to user: Instance 60d6e5d5-d743-4b20-9b13-602e635d1c39 could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 08:59:57.895702 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-793b2f1c-347b-456e-9fce-cf438f5efd9c tempest-DeleteServersTestJSON-213442793 tempest-DeleteServersTestJSON-213442793-project] 10.222.0.46 "GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39" status: 404 len: 111 microversion: 2.1 time: 0.030794 Nov 23 08:59:57.896259 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 136/244] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:57 2021] GET /compute/v2.1/servers/60d6e5d5-d743-4b20-9b13-602e635d1c39 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 23 08:59:58.496823 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-573e855a-8d39-4799-a507-960f60217811 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:58.497954 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-573e855a-8d39-4799-a507-960f60217811 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:58.504236 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-573e855a-8d39-4799-a507-960f60217811 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:58.504988 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-573e855a-8d39-4799-a507-960f60217811 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:58.506031 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-573e855a-8d39-4799-a507-960f60217811 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:58.506537 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-573e855a-8d39-4799-a507-960f60217811 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:58.665300 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-ac1a49df-4ed9-42bc-b0d3-25a1ddb4cbbb tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:58.665917 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-ac1a49df-4ed9-42bc-b0d3-25a1ddb4cbbb tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:58.673107 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-573e855a-8d39-4799-a507-960f60217811 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 25623 microversion: 2.20 time: 0.179781 Nov 23 08:59:58.674810 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 109/245] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 08:59:58 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 25623 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 08:59:58.685362 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ac1a49df-4ed9-42bc-b0d3-25a1ddb4cbbb tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:58.685813 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ac1a49df-4ed9-42bc-b0d3-25a1ddb4cbbb tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:58.687162 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ac1a49df-4ed9-42bc-b0d3-25a1ddb4cbbb tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:58.687600 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ac1a49df-4ed9-42bc-b0d3-25a1ddb4cbbb tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:58.847409 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-3c936b1a-92b1-4037-b637-155a713d90bc tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:58.848517 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-3c936b1a-92b1-4037-b637-155a713d90bc tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 280ce860-8611-44bc-9aa5-0409d2e36937] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:58.862438 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3c936b1a-92b1-4037-b637-155a713d90bc tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:58.862438 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3c936b1a-92b1-4037-b637-155a713d90bc tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:58.862438 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3c936b1a-92b1-4037-b637-155a713d90bc tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:58.862775 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3c936b1a-92b1-4037-b637-155a713d90bc tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:58.870133 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-ac1a49df-4ed9-42bc-b0d3-25a1ddb4cbbb tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:58.880028 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-ac1a49df-4ed9-42bc-b0d3-25a1ddb4cbbb tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.218434 Nov 23 08:59:58.881119 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 137/246] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:58 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 08:59:58.957177 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-3c936b1a-92b1-4037-b637-155a713d90bc tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 08:59:58.973569 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-3c936b1a-92b1-4037-b637-155a713d90bc tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937" status: 200 len: 1270 microversion: 2.1 time: 0.128745 Nov 23 08:59:58.976138 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 110/247] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:58 2021] GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937 => generated 1270 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 08:59:59.690859 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f1b51a7f-10a8-4643-afb5-3a98071f4cb5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 08:59:59.693702 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f1b51a7f-10a8-4643-afb5-3a98071f4cb5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:59.703764 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f1b51a7f-10a8-4643-afb5-3a98071f4cb5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:59.704351 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f1b51a7f-10a8-4643-afb5-3a98071f4cb5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:59.706284 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f1b51a7f-10a8-4643-afb5-3a98071f4cb5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:59.707853 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f1b51a7f-10a8-4643-afb5-3a98071f4cb5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:59.885138 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f1b51a7f-10a8-4643-afb5-3a98071f4cb5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 26124 microversion: 2.20 time: 0.201753 Nov 23 08:59:59.886075 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 138/248] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 08:59:59 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 26124 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 08:59:59.898668 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-86df9ea1-0565-4cc4-8bbd-981622237a47 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:59.899277 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-86df9ea1-0565-4cc4-8bbd-981622237a47 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 08:59:59.908224 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-86df9ea1-0565-4cc4-8bbd-981622237a47 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:59.908681 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-86df9ea1-0565-4cc4-8bbd-981622237a47 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:59.911726 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-86df9ea1-0565-4cc4-8bbd-981622237a47 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 08:59:59.913785 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-86df9ea1-0565-4cc4-8bbd-981622237a47 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 08:59:59.995555 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-7a925df1-58c5-4a84-86bd-8c9f5f62a332 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 08:59:59.996223 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-7a925df1-58c5-4a84-86bd-8c9f5f62a332 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 280ce860-8611-44bc-9aa5-0409d2e36937] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:00.005808 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7a925df1-58c5-4a84-86bd-8c9f5f62a332 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:00.006258 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7a925df1-58c5-4a84-86bd-8c9f5f62a332 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:00.007053 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7a925df1-58c5-4a84-86bd-8c9f5f62a332 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:00.007487 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7a925df1-58c5-4a84-86bd-8c9f5f62a332 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:00.220878 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-7a925df1-58c5-4a84-86bd-8c9f5f62a332 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:00.236543 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-7a925df1-58c5-4a84-86bd-8c9f5f62a332 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937" status: 200 len: 1318 microversion: 2.1 time: 0.244906 Nov 23 09:00:00.237231 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 139/249] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:59 2021] GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937 => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:00:00.456496 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-86df9ea1-0565-4cc4-8bbd-981622237a47 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:00.471935 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-86df9ea1-0565-4cc4-8bbd-981622237a47 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.576779 Nov 23 09:00:00.476947 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 111/250] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 08:59:59 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:00.897592 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b9a266e9-2979-4409-917f-f5b2f1c1a16c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:00.898517 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b9a266e9-2979-4409-917f-f5b2f1c1a16c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:00.910731 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b9a266e9-2979-4409-917f-f5b2f1c1a16c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:00.911205 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b9a266e9-2979-4409-917f-f5b2f1c1a16c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:00.913376 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b9a266e9-2979-4409-917f-f5b2f1c1a16c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:00.913833 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b9a266e9-2979-4409-917f-f5b2f1c1a16c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:01.073370 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b9a266e9-2979-4409-917f-f5b2f1c1a16c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 26553 microversion: 2.20 time: 0.179320 Nov 23 09:00:01.074025 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 140/251] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:00:00 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 26553 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:00:01.075781 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-6b73b5a4-7a8a-4b77-8444-cc592425a030 req-1dc843e5-9006-4f39-a725-876a3ea77c9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "280ce860-8611-44bc-9aa5-0409d2e36937", "tag": "363a793f-0102-402a-a556-ccab80470b94"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:01.078445 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:00:01.078445 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 09:00:01.086711 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-6b73b5a4-7a8a-4b77-8444-cc592425a030 req-1dc843e5-9006-4f39-a725-876a3ea77c9c service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:01.087529 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-6b73b5a4-7a8a-4b77-8444-cc592425a030 req-1dc843e5-9006-4f39-a725-876a3ea77c9c service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:01.122292 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-6b73b5a4-7a8a-4b77-8444-cc592425a030 req-1dc843e5-9006-4f39-a725-876a3ea77c9c service nova] Creating event network-changed:363a793f-0102-402a-a556-ccab80470b94 for instance 280ce860-8611-44bc-9aa5-0409d2e36937 on hv-cinder-76845 Nov 23 09:00:01.127717 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-6b73b5a4-7a8a-4b77-8444-cc592425a030 req-1dc843e5-9006-4f39-a725-876a3ea77c9c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056435 Nov 23 09:00:01.131941 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 112/252] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:00:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 09:00:01.254754 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-0237378c-78d5-436b-97cb-604fc2720689 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:01.255740 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-0237378c-78d5-436b-97cb-604fc2720689 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 280ce860-8611-44bc-9aa5-0409d2e36937] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:01.265929 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0237378c-78d5-436b-97cb-604fc2720689 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:01.266618 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0237378c-78d5-436b-97cb-604fc2720689 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:01.268114 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0237378c-78d5-436b-97cb-604fc2720689 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:01.272437 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0237378c-78d5-436b-97cb-604fc2720689 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:01.448121 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-0237378c-78d5-436b-97cb-604fc2720689 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:01.457444 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-0237378c-78d5-436b-97cb-604fc2720689 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937" status: 200 len: 1318 microversion: 2.1 time: 0.206523 Nov 23 09:00:01.461527 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 141/253] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:01 2021] GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:01.494231 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-d588a473-cdcf-4d72-b7b4-115bd108c0b4 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:01.495536 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-d588a473-cdcf-4d72-b7b4-115bd108c0b4 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:01.506349 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d588a473-cdcf-4d72-b7b4-115bd108c0b4 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:01.507693 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d588a473-cdcf-4d72-b7b4-115bd108c0b4 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:01.510916 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d588a473-cdcf-4d72-b7b4-115bd108c0b4 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:01.513204 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d588a473-cdcf-4d72-b7b4-115bd108c0b4 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:01.821107 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-d588a473-cdcf-4d72-b7b4-115bd108c0b4 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:01.830462 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-d588a473-cdcf-4d72-b7b4-115bd108c0b4 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.341129 Nov 23 09:00:01.831370 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 113/254] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:01 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:02.088560 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8ee4c47c-1c3d-4032-8d0f-b1e97810d846 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:02.089795 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-8ee4c47c-1c3d-4032-8d0f-b1e97810d846 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:02.102939 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8ee4c47c-1c3d-4032-8d0f-b1e97810d846 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:02.103883 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8ee4c47c-1c3d-4032-8d0f-b1e97810d846 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:02.104895 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8ee4c47c-1c3d-4032-8d0f-b1e97810d846 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:02.107395 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8ee4c47c-1c3d-4032-8d0f-b1e97810d846 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:02.238363 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-8ee4c47c-1c3d-4032-8d0f-b1e97810d846 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 27063 microversion: 2.20 time: 0.155064 Nov 23 09:00:02.239086 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 142/255] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:00:02 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 27063 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 09:00:02.481403 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-4938ab0f-ca63-44e5-af12-ec82d585ea10 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:02.483533 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-4938ab0f-ca63-44e5-af12-ec82d585ea10 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 280ce860-8611-44bc-9aa5-0409d2e36937] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:02.493926 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4938ab0f-ca63-44e5-af12-ec82d585ea10 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:02.496337 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4938ab0f-ca63-44e5-af12-ec82d585ea10 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:02.498322 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4938ab0f-ca63-44e5-af12-ec82d585ea10 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:02.500058 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4938ab0f-ca63-44e5-af12-ec82d585ea10 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:02.733997 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-4938ab0f-ca63-44e5-af12-ec82d585ea10 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:02.744408 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-4938ab0f-ca63-44e5-af12-ec82d585ea10 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937" status: 200 len: 1318 microversion: 2.1 time: 0.269628 Nov 23 09:00:02.750420 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 114/256] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:02 2021] GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937 => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:02.849117 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-08161b24-664f-4588-bf41-4c607b9261b0 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:02.850121 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-08161b24-664f-4588-bf41-4c607b9261b0 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:02.865071 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-08161b24-664f-4588-bf41-4c607b9261b0 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:02.865743 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-08161b24-664f-4588-bf41-4c607b9261b0 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:02.866703 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-08161b24-664f-4588-bf41-4c607b9261b0 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:02.867834 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-08161b24-664f-4588-bf41-4c607b9261b0 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:03.094929 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-08161b24-664f-4588-bf41-4c607b9261b0 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:03.111085 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-08161b24-664f-4588-bf41-4c607b9261b0 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.266025 Nov 23 09:00:03.123101 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 143/257] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:02 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:03.254153 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-54fbca08-1987-4870-9acb-41dfa03b7029 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:03.255293 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-54fbca08-1987-4870-9acb-41dfa03b7029 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:03.262904 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-54fbca08-1987-4870-9acb-41dfa03b7029 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:03.263394 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-54fbca08-1987-4870-9acb-41dfa03b7029 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:03.264756 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-54fbca08-1987-4870-9acb-41dfa03b7029 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:03.265437 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-54fbca08-1987-4870-9acb-41dfa03b7029 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:03.397146 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-54fbca08-1987-4870-9acb-41dfa03b7029 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 27448 microversion: 2.20 time: 0.149257 Nov 23 09:00:03.398393 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 115/258] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:00:03 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 27448 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:00:03.762978 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-08f2b69c-ad4e-4d01-9a8f-4b2dc0f3d642 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:03.763705 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-08f2b69c-ad4e-4d01-9a8f-4b2dc0f3d642 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 280ce860-8611-44bc-9aa5-0409d2e36937] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:03.770846 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-08f2b69c-ad4e-4d01-9a8f-4b2dc0f3d642 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:03.771389 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-08f2b69c-ad4e-4d01-9a8f-4b2dc0f3d642 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:03.772265 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-08f2b69c-ad4e-4d01-9a8f-4b2dc0f3d642 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:03.772762 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-08f2b69c-ad4e-4d01-9a8f-4b2dc0f3d642 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:03.921993 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-08f2b69c-ad4e-4d01-9a8f-4b2dc0f3d642 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:03.929590 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-08f2b69c-ad4e-4d01-9a8f-4b2dc0f3d642 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937" status: 200 len: 1318 microversion: 2.1 time: 0.170663 Nov 23 09:00:03.930868 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 144/259] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:03 2021] GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:04.132980 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-6b8c662f-5804-4990-ae3f-5e24919b4c92 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:04.133713 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-6b8c662f-5804-4990-ae3f-5e24919b4c92 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:04.144711 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6b8c662f-5804-4990-ae3f-5e24919b4c92 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:04.145075 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6b8c662f-5804-4990-ae3f-5e24919b4c92 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:04.148909 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6b8c662f-5804-4990-ae3f-5e24919b4c92 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:04.149402 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6b8c662f-5804-4990-ae3f-5e24919b4c92 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:04.365796 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-6b8c662f-5804-4990-ae3f-5e24919b4c92 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:04.377576 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-6b8c662f-5804-4990-ae3f-5e24919b4c92 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.249480 Nov 23 09:00:04.389998 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 116/260] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:04 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:04.408814 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-71c1c7d3-ad17-4e9d-81f9-6d5917018aad tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:04.410003 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-71c1c7d3-ad17-4e9d-81f9-6d5917018aad tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:04.423701 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-71c1c7d3-ad17-4e9d-81f9-6d5917018aad tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:04.427720 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-71c1c7d3-ad17-4e9d-81f9-6d5917018aad tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:04.428822 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-71c1c7d3-ad17-4e9d-81f9-6d5917018aad tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:04.429508 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-71c1c7d3-ad17-4e9d-81f9-6d5917018aad tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:04.583003 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-71c1c7d3-ad17-4e9d-81f9-6d5917018aad tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 27692 microversion: 2.20 time: 0.177682 Nov 23 09:00:04.583590 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 145/261] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:00:04 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 27692 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:00:04.947292 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-b24c8ad6-cd71-4f3d-80e5-87d6237cf5f0 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:04.948137 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-b24c8ad6-cd71-4f3d-80e5-87d6237cf5f0 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 280ce860-8611-44bc-9aa5-0409d2e36937] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:04.955765 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b24c8ad6-cd71-4f3d-80e5-87d6237cf5f0 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:04.956367 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b24c8ad6-cd71-4f3d-80e5-87d6237cf5f0 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:04.957486 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b24c8ad6-cd71-4f3d-80e5-87d6237cf5f0 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:04.957929 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b24c8ad6-cd71-4f3d-80e5-87d6237cf5f0 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:05.106079 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-b24c8ad6-cd71-4f3d-80e5-87d6237cf5f0 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:05.114292 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-b24c8ad6-cd71-4f3d-80e5-87d6237cf5f0 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937" status: 200 len: 1318 microversion: 2.1 time: 0.170768 Nov 23 09:00:05.115409 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 117/262] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:04 2021] GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:05.395242 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-0ae31c32-a520-4a95-97df-eb4e5829e413 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:05.396143 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-0ae31c32-a520-4a95-97df-eb4e5829e413 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:05.403998 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ae31c32-a520-4a95-97df-eb4e5829e413 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:05.405129 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ae31c32-a520-4a95-97df-eb4e5829e413 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:05.406327 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ae31c32-a520-4a95-97df-eb4e5829e413 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:05.407162 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ae31c32-a520-4a95-97df-eb4e5829e413 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:05.570257 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-0ae31c32-a520-4a95-97df-eb4e5829e413 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:05.579553 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-0ae31c32-a520-4a95-97df-eb4e5829e413 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.188194 Nov 23 09:00:05.580140 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 146/263] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:05 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:05.595552 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-7f872373-b8ee-4fc4-b73b-1e4edf0dde95 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:05.597093 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-7f872373-b8ee-4fc4-b73b-1e4edf0dde95 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:05.606532 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7f872373-b8ee-4fc4-b73b-1e4edf0dde95 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:05.606990 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7f872373-b8ee-4fc4-b73b-1e4edf0dde95 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:05.607826 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7f872373-b8ee-4fc4-b73b-1e4edf0dde95 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:05.608260 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7f872373-b8ee-4fc4-b73b-1e4edf0dde95 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:06.132723 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-28e1e806-4ea4-43b0-a868-5014b4a8a17a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:06.133387 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-28e1e806-4ea4-43b0-a868-5014b4a8a17a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 280ce860-8611-44bc-9aa5-0409d2e36937] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:06.156637 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-28e1e806-4ea4-43b0-a868-5014b4a8a17a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:06.157140 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-28e1e806-4ea4-43b0-a868-5014b4a8a17a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:06.157930 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-28e1e806-4ea4-43b0-a868-5014b4a8a17a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:06.158373 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-28e1e806-4ea4-43b0-a868-5014b4a8a17a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:06.360349 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-28e1e806-4ea4-43b0-a868-5014b4a8a17a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:06.368568 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-28e1e806-4ea4-43b0-a868-5014b4a8a17a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937" status: 200 len: 1318 microversion: 2.1 time: 0.240152 Nov 23 09:00:06.369384 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 147/264] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:06 2021] GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:00:06.595934 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-1f605fc9-4965-47f7-afc6-a8b32e9b858a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:06.596617 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-1f605fc9-4965-47f7-afc6-a8b32e9b858a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:06.602993 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1f605fc9-4965-47f7-afc6-a8b32e9b858a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:06.603443 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1f605fc9-4965-47f7-afc6-a8b32e9b858a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:06.604218 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1f605fc9-4965-47f7-afc6-a8b32e9b858a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:06.604650 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1f605fc9-4965-47f7-afc6-a8b32e9b858a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:06.742798 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-1f605fc9-4965-47f7-afc6-a8b32e9b858a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:06.750688 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-1f605fc9-4965-47f7-afc6-a8b32e9b858a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.158836 Nov 23 09:00:06.751389 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 148/265] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:06 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:00:07.386901 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-38e42c8c-13f1-469d-93c6-a902e1bae71e tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:07.387509 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-38e42c8c-13f1-469d-93c6-a902e1bae71e tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 280ce860-8611-44bc-9aa5-0409d2e36937] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:07.393638 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-38e42c8c-13f1-469d-93c6-a902e1bae71e tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:07.394092 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-38e42c8c-13f1-469d-93c6-a902e1bae71e tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:07.394884 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-38e42c8c-13f1-469d-93c6-a902e1bae71e tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:07.395330 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-38e42c8c-13f1-469d-93c6-a902e1bae71e tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:07.573253 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-38e42c8c-13f1-469d-93c6-a902e1bae71e tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:07.581422 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-38e42c8c-13f1-469d-93c6-a902e1bae71e tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937" status: 200 len: 1318 microversion: 2.1 time: 0.198486 Nov 23 09:00:07.582092 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 149/266] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:07 2021] GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937 => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:07.767385 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-743ffc1c-7185-499a-9564-d370bac593f5 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:07.768000 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-743ffc1c-7185-499a-9564-d370bac593f5 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:07.773870 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-743ffc1c-7185-499a-9564-d370bac593f5 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:07.774326 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-743ffc1c-7185-499a-9564-d370bac593f5 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:07.775113 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-743ffc1c-7185-499a-9564-d370bac593f5 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:07.775548 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-743ffc1c-7185-499a-9564-d370bac593f5 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:07.905371 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-743ffc1c-7185-499a-9564-d370bac593f5 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:07.912832 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-743ffc1c-7185-499a-9564-d370bac593f5 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.149551 Nov 23 09:00:07.913430 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 150/267] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:07 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:00:08.049929 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-7f872373-b8ee-4fc4-b73b-1e4edf0dde95 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 27751 microversion: 2.20 time: 2.458761 Nov 23 09:00:08.051177 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 118/268] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:00:05 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 27751 bytes in 2461 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:00:08.598540 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-bd1ef73e-bd0d-4ddf-a1d3-a44475a1f3dd tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:08.599174 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-bd1ef73e-bd0d-4ddf-a1d3-a44475a1f3dd tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 280ce860-8611-44bc-9aa5-0409d2e36937] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:08.605681 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bd1ef73e-bd0d-4ddf-a1d3-a44475a1f3dd tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:08.606137 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bd1ef73e-bd0d-4ddf-a1d3-a44475a1f3dd tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:08.606982 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bd1ef73e-bd0d-4ddf-a1d3-a44475a1f3dd tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:08.607428 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bd1ef73e-bd0d-4ddf-a1d3-a44475a1f3dd tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:08.848330 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-bd1ef73e-bd0d-4ddf-a1d3-a44475a1f3dd tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:08.856087 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-bd1ef73e-bd0d-4ddf-a1d3-a44475a1f3dd tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937" status: 200 len: 1318 microversion: 2.1 time: 0.261055 Nov 23 09:00:08.863985 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 151/269] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:08 2021] GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937 => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:08.930754 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-a21077b6-4f47-4d07-bfce-4d658162e0fd tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:08.931471 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-a21077b6-4f47-4d07-bfce-4d658162e0fd tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:08.939152 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a21077b6-4f47-4d07-bfce-4d658162e0fd tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:08.939600 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a21077b6-4f47-4d07-bfce-4d658162e0fd tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:08.940526 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a21077b6-4f47-4d07-bfce-4d658162e0fd tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:08.940960 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a21077b6-4f47-4d07-bfce-4d658162e0fd tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:09.061857 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d15d75d3-cec5-42cf-8518-e7f1ecbc1bad tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:09.062933 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d15d75d3-cec5-42cf-8518-e7f1ecbc1bad tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:09.069378 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d15d75d3-cec5-42cf-8518-e7f1ecbc1bad tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:09.069983 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d15d75d3-cec5-42cf-8518-e7f1ecbc1bad tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:09.070773 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d15d75d3-cec5-42cf-8518-e7f1ecbc1bad tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:09.071388 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d15d75d3-cec5-42cf-8518-e7f1ecbc1bad tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:09.114630 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-a21077b6-4f47-4d07-bfce-4d658162e0fd tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:09.121919 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-a21077b6-4f47-4d07-bfce-4d658162e0fd tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.195165 Nov 23 09:00:09.122901 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 119/270] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:08 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:09.198490 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d15d75d3-cec5-42cf-8518-e7f1ecbc1bad tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 28051 microversion: 2.20 time: 0.140602 Nov 23 09:00:09.199334 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 152/271] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:00:09 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 28051 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:00:09.880749 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-d08858e8-0c59-4329-aaf2-c34a7e4be8d4 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:09.881532 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-d08858e8-0c59-4329-aaf2-c34a7e4be8d4 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 280ce860-8611-44bc-9aa5-0409d2e36937] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:09.888261 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d08858e8-0c59-4329-aaf2-c34a7e4be8d4 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:09.888716 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d08858e8-0c59-4329-aaf2-c34a7e4be8d4 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:09.889823 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d08858e8-0c59-4329-aaf2-c34a7e4be8d4 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:09.890356 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d08858e8-0c59-4329-aaf2-c34a7e4be8d4 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:10.029769 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-d08858e8-0c59-4329-aaf2-c34a7e4be8d4 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:10.038554 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-d08858e8-0c59-4329-aaf2-c34a7e4be8d4 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937" status: 200 len: 1318 microversion: 2.1 time: 0.161861 Nov 23 09:00:10.039143 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 120/272] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:09 2021] GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:10.140228 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-cac4488e-0795-4089-b893-ee7d0527ac83 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:10.140922 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-cac4488e-0795-4089-b893-ee7d0527ac83 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:10.147968 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cac4488e-0795-4089-b893-ee7d0527ac83 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:10.148454 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cac4488e-0795-4089-b893-ee7d0527ac83 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:10.149279 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cac4488e-0795-4089-b893-ee7d0527ac83 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:10.149723 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cac4488e-0795-4089-b893-ee7d0527ac83 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:10.210665 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-4da4b260-b5b5-448c-b542-e10bca528aa8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:10.218125 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-4da4b260-b5b5-448c-b542-e10bca528aa8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:10.226851 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4da4b260-b5b5-448c-b542-e10bca528aa8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:10.227310 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4da4b260-b5b5-448c-b542-e10bca528aa8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:10.228116 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4da4b260-b5b5-448c-b542-e10bca528aa8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:10.228550 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4da4b260-b5b5-448c-b542-e10bca528aa8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:10.289007 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-cac4488e-0795-4089-b893-ee7d0527ac83 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:10.297301 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-cac4488e-0795-4089-b893-ee7d0527ac83 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.161760 Nov 23 09:00:10.297870 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 153/273] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:10 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:10.344065 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-4da4b260-b5b5-448c-b542-e10bca528aa8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 28163 microversion: 2.20 time: 0.137012 Nov 23 09:00:10.347876 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 121/274] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:00:10 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 28163 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 09:00:11.056568 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-77d1b859-46c2-4fa4-8877-c5fcef92aee1 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:11.059222 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-77d1b859-46c2-4fa4-8877-c5fcef92aee1 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 280ce860-8611-44bc-9aa5-0409d2e36937] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:11.067694 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-77d1b859-46c2-4fa4-8877-c5fcef92aee1 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:11.068299 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-77d1b859-46c2-4fa4-8877-c5fcef92aee1 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:11.069280 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-77d1b859-46c2-4fa4-8877-c5fcef92aee1 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:11.069871 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-77d1b859-46c2-4fa4-8877-c5fcef92aee1 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:11.082454 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-f43db559-d9b6-431e-991d-c5d8eff610a5 req-7cb56773-f9d1-4ff4-91ec-5ce9ad98fd1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "280ce860-8611-44bc-9aa5-0409d2e36937", "name": "network-vif-plugged", "status": "completed", "tag": "363a793f-0102-402a-a556-ccab80470b94"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:11.084199 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:00:11.084199 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 09:00:11.103897 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-f43db559-d9b6-431e-991d-c5d8eff610a5 req-7cb56773-f9d1-4ff4-91ec-5ce9ad98fd1c service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:11.104572 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-f43db559-d9b6-431e-991d-c5d8eff610a5 req-7cb56773-f9d1-4ff4-91ec-5ce9ad98fd1c service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:11.125358 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-f43db559-d9b6-431e-991d-c5d8eff610a5 req-7cb56773-f9d1-4ff4-91ec-5ce9ad98fd1c service nova] Creating event network-vif-plugged:363a793f-0102-402a-a556-ccab80470b94 for instance 280ce860-8611-44bc-9aa5-0409d2e36937 on hv-cinder-76845 Nov 23 09:00:11.131013 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-f43db559-d9b6-431e-991d-c5d8eff610a5 req-7cb56773-f9d1-4ff4-91ec-5ce9ad98fd1c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052511 Nov 23 09:00:11.132074 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 122/275] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:00:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:00:11.274531 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-77d1b859-46c2-4fa4-8877-c5fcef92aee1 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:11.291728 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-77d1b859-46c2-4fa4-8877-c5fcef92aee1 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937" status: 200 len: 1318 microversion: 2.1 time: 0.238601 Nov 23 09:00:11.292332 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 154/276] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:11 2021] GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:11.316232 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-8c710fb3-bc7d-47f3-8076-3c0f51a9381d tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:11.317560 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-8c710fb3-bc7d-47f3-8076-3c0f51a9381d tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:11.323883 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8c710fb3-bc7d-47f3-8076-3c0f51a9381d tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:11.324437 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8c710fb3-bc7d-47f3-8076-3c0f51a9381d tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:11.325363 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8c710fb3-bc7d-47f3-8076-3c0f51a9381d tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:11.325871 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8c710fb3-bc7d-47f3-8076-3c0f51a9381d tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:11.356405 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-7e23598b-8bf5-4220-a1ca-51e01aaf821e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:11.358184 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-7e23598b-8bf5-4220-a1ca-51e01aaf821e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:11.365412 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7e23598b-8bf5-4220-a1ca-51e01aaf821e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:11.369538 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7e23598b-8bf5-4220-a1ca-51e01aaf821e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:11.370801 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7e23598b-8bf5-4220-a1ca-51e01aaf821e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:11.371460 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7e23598b-8bf5-4220-a1ca-51e01aaf821e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:11.475056 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-8c710fb3-bc7d-47f3-8076-3c0f51a9381d tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:11.482298 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-8c710fb3-bc7d-47f3-8076-3c0f51a9381d tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.170899 Nov 23 09:00:11.482965 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 123/277] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:11 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:12.309434 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-41a436d8-ecc0-4777-95bb-ebbd59801d5c tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:12.310042 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-41a436d8-ecc0-4777-95bb-ebbd59801d5c tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 280ce860-8611-44bc-9aa5-0409d2e36937] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:12.316897 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-41a436d8-ecc0-4777-95bb-ebbd59801d5c tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:12.317504 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-41a436d8-ecc0-4777-95bb-ebbd59801d5c tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:12.318148 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-41a436d8-ecc0-4777-95bb-ebbd59801d5c tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:12.318582 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-41a436d8-ecc0-4777-95bb-ebbd59801d5c tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:12.455034 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-41a436d8-ecc0-4777-95bb-ebbd59801d5c tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:12.462319 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-41a436d8-ecc0-4777-95bb-ebbd59801d5c tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937" status: 200 len: 1318 microversion: 2.1 time: 0.156478 Nov 23 09:00:12.463125 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 124/278] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:12 2021] GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:00:12.498329 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-900ac085-9640-41ca-a929-40a36cbc9348 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:12.499106 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-900ac085-9640-41ca-a929-40a36cbc9348 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:12.504931 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-900ac085-9640-41ca-a929-40a36cbc9348 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:12.505456 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-900ac085-9640-41ca-a929-40a36cbc9348 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:12.506288 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-900ac085-9640-41ca-a929-40a36cbc9348 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:12.506932 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-900ac085-9640-41ca-a929-40a36cbc9348 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:12.639537 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-900ac085-9640-41ca-a929-40a36cbc9348 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:12.647609 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-900ac085-9640-41ca-a929-40a36cbc9348 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.152807 Nov 23 09:00:12.648203 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 125/279] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:12 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:00:13.479854 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-db0bd39e-2e5b-4084-bd9e-de0074335477 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:13.480791 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-db0bd39e-2e5b-4084-bd9e-de0074335477 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 280ce860-8611-44bc-9aa5-0409d2e36937] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:13.487271 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-db0bd39e-2e5b-4084-bd9e-de0074335477 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:13.487758 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-db0bd39e-2e5b-4084-bd9e-de0074335477 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:13.488560 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-db0bd39e-2e5b-4084-bd9e-de0074335477 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:13.489023 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-db0bd39e-2e5b-4084-bd9e-de0074335477 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:13.628038 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-db0bd39e-2e5b-4084-bd9e-de0074335477 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:13.635228 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-db0bd39e-2e5b-4084-bd9e-de0074335477 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937" status: 200 len: 1318 microversion: 2.1 time: 0.158943 Nov 23 09:00:13.635842 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 126/280] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:13 2021] GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:00:13.664210 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-540f7862-12f6-46eb-834b-0a442bc2e962 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:13.664847 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-540f7862-12f6-46eb-834b-0a442bc2e962 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:13.671857 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-540f7862-12f6-46eb-834b-0a442bc2e962 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:13.672522 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-540f7862-12f6-46eb-834b-0a442bc2e962 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:13.673829 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-540f7862-12f6-46eb-834b-0a442bc2e962 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:13.674469 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-540f7862-12f6-46eb-834b-0a442bc2e962 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:13.821458 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-540f7862-12f6-46eb-834b-0a442bc2e962 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:13.831459 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-540f7862-12f6-46eb-834b-0a442bc2e962 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.170882 Nov 23 09:00:13.832415 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 127/281] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:13 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:14.071305 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-7e23598b-8bf5-4220-a1ca-51e01aaf821e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 28163 microversion: 2.20 time: 2.719259 Nov 23 09:00:14.072027 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 155/282] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:00:11 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 28163 bytes in 2721 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 09:00:14.654257 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-1194a641-1147-4e20-b88e-67914775ff11 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:14.655180 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-1194a641-1147-4e20-b88e-67914775ff11 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 280ce860-8611-44bc-9aa5-0409d2e36937] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:14.662589 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1194a641-1147-4e20-b88e-67914775ff11 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:14.663233 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1194a641-1147-4e20-b88e-67914775ff11 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:14.664487 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1194a641-1147-4e20-b88e-67914775ff11 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:14.665127 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1194a641-1147-4e20-b88e-67914775ff11 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:14.806606 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-1194a641-1147-4e20-b88e-67914775ff11 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:14.814595 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-1194a641-1147-4e20-b88e-67914775ff11 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937" status: 200 len: 1318 microversion: 2.1 time: 0.165357 Nov 23 09:00:14.815401 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 128/283] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:14 2021] GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:14.851397 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-0683242e-efb3-447d-8750-3450702b4e49 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:14.852245 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-0683242e-efb3-447d-8750-3450702b4e49 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:14.859876 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0683242e-efb3-447d-8750-3450702b4e49 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:14.860467 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0683242e-efb3-447d-8750-3450702b4e49 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:14.861389 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0683242e-efb3-447d-8750-3450702b4e49 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:14.862065 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0683242e-efb3-447d-8750-3450702b4e49 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:15.056127 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-0683242e-efb3-447d-8750-3450702b4e49 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:15.064173 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-0683242e-efb3-447d-8750-3450702b4e49 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.217354 Nov 23 09:00:15.070739 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 156/284] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:14 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:15.083770 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-4efa5cb5-452d-40d2-88dd-ea66a8432abc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:15.084691 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-4efa5cb5-452d-40d2-88dd-ea66a8432abc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:15.093617 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4efa5cb5-452d-40d2-88dd-ea66a8432abc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:15.095022 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4efa5cb5-452d-40d2-88dd-ea66a8432abc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:15.096131 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4efa5cb5-452d-40d2-88dd-ea66a8432abc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:15.096737 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4efa5cb5-452d-40d2-88dd-ea66a8432abc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:15.183205 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-4efa5cb5-452d-40d2-88dd-ea66a8432abc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 28163 microversion: 2.20 time: 0.102960 Nov 23 09:00:15.187567 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 129/285] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:00:15 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 28163 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 09:00:15.832617 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-fec81581-7c7e-430a-97ce-6e4db961f50b tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:15.833808 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-fec81581-7c7e-430a-97ce-6e4db961f50b tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 280ce860-8611-44bc-9aa5-0409d2e36937] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:15.842870 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fec81581-7c7e-430a-97ce-6e4db961f50b tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:15.843809 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fec81581-7c7e-430a-97ce-6e4db961f50b tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:15.844816 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fec81581-7c7e-430a-97ce-6e4db961f50b tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:15.845546 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fec81581-7c7e-430a-97ce-6e4db961f50b tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:16.004437 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-fec81581-7c7e-430a-97ce-6e4db961f50b tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:16.011532 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-fec81581-7c7e-430a-97ce-6e4db961f50b tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937" status: 200 len: 1507 microversion: 2.1 time: 0.183655 Nov 23 09:00:16.012111 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 157/286] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:15 2021] GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937 => generated 1507 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:16.100377 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-abf9bc4f-6038-4ea2-a9b6-0a31527ea672 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:16.102151 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-abf9bc4f-6038-4ea2-a9b6-0a31527ea672 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:16.108806 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-abf9bc4f-6038-4ea2-a9b6-0a31527ea672 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:16.109510 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-abf9bc4f-6038-4ea2-a9b6-0a31527ea672 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:16.110310 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-abf9bc4f-6038-4ea2-a9b6-0a31527ea672 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:16.110747 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-abf9bc4f-6038-4ea2-a9b6-0a31527ea672 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:16.196434 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-9a2ef4e2-f1d0-4947-ae3d-b5998185aff0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:16.198932 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-9a2ef4e2-f1d0-4947-ae3d-b5998185aff0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:16.209359 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9a2ef4e2-f1d0-4947-ae3d-b5998185aff0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:16.210015 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9a2ef4e2-f1d0-4947-ae3d-b5998185aff0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:16.211478 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9a2ef4e2-f1d0-4947-ae3d-b5998185aff0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:16.212135 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9a2ef4e2-f1d0-4947-ae3d-b5998185aff0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:16.278009 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-abf9bc4f-6038-4ea2-a9b6-0a31527ea672 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:16.290740 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-abf9bc4f-6038-4ea2-a9b6-0a31527ea672 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.210699 Nov 23 09:00:16.292544 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 130/287] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:16 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:16.316159 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-9a2ef4e2-f1d0-4947-ae3d-b5998185aff0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 28163 microversion: 2.20 time: 0.124508 Nov 23 09:00:16.316803 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 158/288] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:00:16 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 28163 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 09:00:17.310236 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-b143fe4f-9fbe-4a6b-8b93-87fea4ce19aa tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:17.312158 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-b143fe4f-9fbe-4a6b-8b93-87fea4ce19aa tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:17.319949 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b143fe4f-9fbe-4a6b-8b93-87fea4ce19aa tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:17.320615 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b143fe4f-9fbe-4a6b-8b93-87fea4ce19aa tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:17.321943 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b143fe4f-9fbe-4a6b-8b93-87fea4ce19aa tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:17.322665 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b143fe4f-9fbe-4a6b-8b93-87fea4ce19aa tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:17.333094 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-561a3655-acfc-4cd4-96ba-40bd8b790803 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:17.334700 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-561a3655-acfc-4cd4-96ba-40bd8b790803 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:17.348623 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-561a3655-acfc-4cd4-96ba-40bd8b790803 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:17.348967 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-561a3655-acfc-4cd4-96ba-40bd8b790803 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:17.349826 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-561a3655-acfc-4cd4-96ba-40bd8b790803 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:17.350267 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-561a3655-acfc-4cd4-96ba-40bd8b790803 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:17.474864 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-b143fe4f-9fbe-4a6b-8b93-87fea4ce19aa tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:17.484457 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-b143fe4f-9fbe-4a6b-8b93-87fea4ce19aa tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.179132 Nov 23 09:00:17.485402 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 131/289] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:17 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:17.491663 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-994b9af7-f168-4e2d-a040-2f92e69bbed6 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "376f5c37-c431-442c-8478-55093ffc860a"}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:17.493098 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-994b9af7-f168-4e2d-a040-2f92e69bbed6 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 280ce860-8611-44bc-9aa5-0409d2e36937] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:17.500073 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-994b9af7-f168-4e2d-a040-2f92e69bbed6 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:17.500738 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-994b9af7-f168-4e2d-a040-2f92e69bbed6 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:17.502034 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-994b9af7-f168-4e2d-a040-2f92e69bbed6 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:17.502774 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-994b9af7-f168-4e2d-a040-2f92e69bbed6 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:17.527872 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-561a3655-acfc-4cd4-96ba-40bd8b790803 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 28450 microversion: 2.20 time: 0.202999 Nov 23 09:00:17.532713 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 159/290] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:00:17 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 28450 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:00:17.806332 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-994b9af7-f168-4e2d-a040-2f92e69bbed6 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "POST /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319324 Nov 23 09:00:17.807176 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 132/291] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 23 09:00:17 2021] POST /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:00:18.503141 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-3d3b769a-c26a-4502-8b2e-61b6bf7b963c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:18.503956 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-3d3b769a-c26a-4502-8b2e-61b6bf7b963c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:18.511178 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3d3b769a-c26a-4502-8b2e-61b6bf7b963c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:18.511723 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3d3b769a-c26a-4502-8b2e-61b6bf7b963c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:18.512573 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3d3b769a-c26a-4502-8b2e-61b6bf7b963c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:18.513081 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3d3b769a-c26a-4502-8b2e-61b6bf7b963c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:18.541371 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-baaad3f7-ef21-4155-8e1b-420047470789 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:18.543026 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-baaad3f7-ef21-4155-8e1b-420047470789 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:18.550570 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-baaad3f7-ef21-4155-8e1b-420047470789 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:18.551292 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-baaad3f7-ef21-4155-8e1b-420047470789 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:18.552076 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-baaad3f7-ef21-4155-8e1b-420047470789 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:18.552566 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-baaad3f7-ef21-4155-8e1b-420047470789 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:18.702698 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-baaad3f7-ef21-4155-8e1b-420047470789 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 28450 microversion: 2.20 time: 0.165763 Nov 23 09:00:18.708305 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 133/292] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:00:18 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 28450 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 09:00:18.723981 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-3d3b769a-c26a-4502-8b2e-61b6bf7b963c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:18.731335 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-3d3b769a-c26a-4502-8b2e-61b6bf7b963c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1520 microversion: 2.1 time: 0.232162 Nov 23 09:00:18.731904 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 160/293] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:18 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:19.715410 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-b4a9baa7-c940-41bf-b492-78adcdabd8f2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:19.716485 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-b4a9baa7-c940-41bf-b492-78adcdabd8f2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:19.724349 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b4a9baa7-c940-41bf-b492-78adcdabd8f2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:19.724803 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b4a9baa7-c940-41bf-b492-78adcdabd8f2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:19.725623 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b4a9baa7-c940-41bf-b492-78adcdabd8f2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:19.726063 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b4a9baa7-c940-41bf-b492-78adcdabd8f2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:19.749808 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a3023dd1-ad8f-4a16-b21b-07fdb5f87d6e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:19.750947 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a3023dd1-ad8f-4a16-b21b-07fdb5f87d6e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:19.756931 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a3023dd1-ad8f-4a16-b21b-07fdb5f87d6e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:19.757411 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a3023dd1-ad8f-4a16-b21b-07fdb5f87d6e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:19.758191 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a3023dd1-ad8f-4a16-b21b-07fdb5f87d6e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:19.758620 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a3023dd1-ad8f-4a16-b21b-07fdb5f87d6e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:19.846780 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-b4a9baa7-c940-41bf-b492-78adcdabd8f2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 28586 microversion: 2.20 time: 0.135513 Nov 23 09:00:19.847686 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 134/294] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:00:19 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 28586 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:00:19.899397 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a3023dd1-ad8f-4a16-b21b-07fdb5f87d6e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:19.907287 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a3023dd1-ad8f-4a16-b21b-07fdb5f87d6e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1500 microversion: 2.1 time: 0.161477 Nov 23 09:00:19.907850 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 161/295] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:19 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1500 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:00:19.924237 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-ed86fcd0-3432-41e6-bf00-fd904973ece7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:19.924935 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-ed86fcd0-3432-41e6-bf00-fd904973ece7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:19.931971 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ed86fcd0-3432-41e6-bf00-fd904973ece7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:19.932427 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ed86fcd0-3432-41e6-bf00-fd904973ece7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:19.933231 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ed86fcd0-3432-41e6-bf00-fd904973ece7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:19.933703 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ed86fcd0-3432-41e6-bf00-fd904973ece7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:20.079535 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-ed86fcd0-3432-41e6-bf00-fd904973ece7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:20.087514 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-ed86fcd0-3432-41e6-bf00-fd904973ece7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1514 microversion: 2.1 time: 0.167800 Nov 23 09:00:20.088089 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 135/296] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:19 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:20.859422 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-78b7b192-aeec-4b12-b03f-1e65d513f5f8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:20.860409 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-78b7b192-aeec-4b12-b03f-1e65d513f5f8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:20.866354 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-78b7b192-aeec-4b12-b03f-1e65d513f5f8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:20.866798 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-78b7b192-aeec-4b12-b03f-1e65d513f5f8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:20.867571 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-78b7b192-aeec-4b12-b03f-1e65d513f5f8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:20.867999 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-78b7b192-aeec-4b12-b03f-1e65d513f5f8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:20.979480 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-78b7b192-aeec-4b12-b03f-1e65d513f5f8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 28613 microversion: 2.20 time: 0.124226 Nov 23 09:00:20.980569 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 162/297] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:00:20 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 28613 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 09:00:21.133920 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-a40e72d2-c34a-43af-8118-94d3829d2eba tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73303790-f158-4352-9f49-bf9433affbe6", "device": "/dev/sdb"}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:21.135830 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-a40e72d2-c34a-43af-8118-94d3829d2eba tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: 1b386ea7-77b5-48b4-a375-10966f3dd299] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:21.142644 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a40e72d2-c34a-43af-8118-94d3829d2eba tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:21.143097 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a40e72d2-c34a-43af-8118-94d3829d2eba tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:21.143883 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a40e72d2-c34a-43af-8118-94d3829d2eba tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:21.144344 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a40e72d2-c34a-43af-8118-94d3829d2eba tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:21.419176 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-a40e72d2-c34a-43af-8118-94d3829d2eba tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "POST /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289005 Nov 23 09:00:21.420154 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 136/298] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 23 09:00:21 2021] POST /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:00:21.450090 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-90c25d9c-9760-4f39-b8ff-2bde7862911d tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:21.451798 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-90c25d9c-9760-4f39-b8ff-2bde7862911d tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:21.458581 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-90c25d9c-9760-4f39-b8ff-2bde7862911d tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:21.459206 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-90c25d9c-9760-4f39-b8ff-2bde7862911d tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:21.460415 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-90c25d9c-9760-4f39-b8ff-2bde7862911d tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:21.460839 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-90c25d9c-9760-4f39-b8ff-2bde7862911d tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:21.491647 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.objects.instance [None req-90c25d9c-9760-4f39-b8ff-2bde7862911d tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lazy-loading 'flavor' on Instance uuid 4e7614ff-90ad-4ed2-9d48-3b0585258f88 {{(pid=116226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 09:00:21.608141 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-90c25d9c-9760-4f39-b8ff-2bde7862911d tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "POST /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88/action" status: 200 len: 32 microversion: 2.1 time: 0.162826 Nov 23 09:00:21.609052 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 163/299] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:00:21 2021] POST /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88/action => generated 32 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 09:00:21.619251 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-05e7325f-451d-480e-8bc0-2389133c730f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:21.625749 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-05e7325f-451d-480e-8bc0-2389133c730f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:21.633221 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-05e7325f-451d-480e-8bc0-2389133c730f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:21.633802 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-05e7325f-451d-480e-8bc0-2389133c730f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:21.634585 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-05e7325f-451d-480e-8bc0-2389133c730f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:21.635211 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-05e7325f-451d-480e-8bc0-2389133c730f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:21.950129 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-05e7325f-451d-480e-8bc0-2389133c730f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:21.958096 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-05e7325f-451d-480e-8bc0-2389133c730f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1520 microversion: 2.1 time: 0.343292 Nov 23 09:00:21.958670 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 137/300] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:21 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1520 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:21.992461 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-6a95583d-54f6-43af-b234-475d4e8fb333 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:21.993567 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-6a95583d-54f6-43af-b234-475d4e8fb333 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:22.001282 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6a95583d-54f6-43af-b234-475d4e8fb333 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:22.001730 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6a95583d-54f6-43af-b234-475d4e8fb333 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:22.002608 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6a95583d-54f6-43af-b234-475d4e8fb333 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:22.002939 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6a95583d-54f6-43af-b234-475d4e8fb333 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:22.154795 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-6a95583d-54f6-43af-b234-475d4e8fb333 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 28613 microversion: 2.20 time: 0.165745 Nov 23 09:00:22.155546 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 164/301] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:00:21 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 28613 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:00:22.976925 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-0a48c57d-7a11-4092-bd07-2be752a2e31a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:22.978042 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-0a48c57d-7a11-4092-bd07-2be752a2e31a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:22.987167 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0a48c57d-7a11-4092-bd07-2be752a2e31a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:22.987624 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0a48c57d-7a11-4092-bd07-2be752a2e31a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:22.988412 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0a48c57d-7a11-4092-bd07-2be752a2e31a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:22.988882 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0a48c57d-7a11-4092-bd07-2be752a2e31a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:23.137561 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-0a48c57d-7a11-4092-bd07-2be752a2e31a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:23.145884 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-0a48c57d-7a11-4092-bd07-2be752a2e31a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1520 microversion: 2.1 time: 0.173802 Nov 23 09:00:23.146472 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 138/302] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:22 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:23.170984 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e200152b-81c8-44d3-bd57-65dfde54a524 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:23.171999 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e200152b-81c8-44d3-bd57-65dfde54a524 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:23.179333 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e200152b-81c8-44d3-bd57-65dfde54a524 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:23.179798 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e200152b-81c8-44d3-bd57-65dfde54a524 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:23.180578 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e200152b-81c8-44d3-bd57-65dfde54a524 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:23.181004 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e200152b-81c8-44d3-bd57-65dfde54a524 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:23.257954 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e200152b-81c8-44d3-bd57-65dfde54a524 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 28613 microversion: 2.20 time: 0.093159 Nov 23 09:00:23.259440 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 165/303] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:00:23 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 28613 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:00:24.163628 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-38ce2b27-b402-4bf4-a756-8d15e010b58f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:24.164231 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-38ce2b27-b402-4bf4-a756-8d15e010b58f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:24.170763 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-38ce2b27-b402-4bf4-a756-8d15e010b58f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:24.171389 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-38ce2b27-b402-4bf4-a756-8d15e010b58f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:24.172482 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-38ce2b27-b402-4bf4-a756-8d15e010b58f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:24.173199 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-38ce2b27-b402-4bf4-a756-8d15e010b58f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:24.271078 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f7990c8f-7fe7-4ad3-89da-822002f27d85 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:24.272078 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f7990c8f-7fe7-4ad3-89da-822002f27d85 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:24.278628 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f7990c8f-7fe7-4ad3-89da-822002f27d85 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:24.279107 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f7990c8f-7fe7-4ad3-89da-822002f27d85 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:24.279930 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f7990c8f-7fe7-4ad3-89da-822002f27d85 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:24.280359 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f7990c8f-7fe7-4ad3-89da-822002f27d85 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:24.347175 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-38ce2b27-b402-4bf4-a756-8d15e010b58f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:24.354743 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-38ce2b27-b402-4bf4-a756-8d15e010b58f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1520 microversion: 2.1 time: 0.194850 Nov 23 09:00:24.355347 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 139/304] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:24 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:24.383982 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f7990c8f-7fe7-4ad3-89da-822002f27d85 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 28613 microversion: 2.20 time: 0.117081 Nov 23 09:00:24.385917 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 166/305] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:00:24 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 28613 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 09:00:25.371736 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-fb355d97-b63f-4bc3-b157-d00e8c02338a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:25.372349 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-fb355d97-b63f-4bc3-b157-d00e8c02338a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:25.379236 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-fb355d97-b63f-4bc3-b157-d00e8c02338a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:25.379705 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-fb355d97-b63f-4bc3-b157-d00e8c02338a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:25.380495 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-fb355d97-b63f-4bc3-b157-d00e8c02338a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:25.380968 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-fb355d97-b63f-4bc3-b157-d00e8c02338a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:25.396495 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c092d65b-819e-4567-b5be-1fc63f9cafd8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:25.397637 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c092d65b-819e-4567-b5be-1fc63f9cafd8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:25.406410 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c092d65b-819e-4567-b5be-1fc63f9cafd8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:25.406972 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c092d65b-819e-4567-b5be-1fc63f9cafd8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:25.407852 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c092d65b-819e-4567-b5be-1fc63f9cafd8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:25.408383 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c092d65b-819e-4567-b5be-1fc63f9cafd8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:25.493544 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c092d65b-819e-4567-b5be-1fc63f9cafd8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 28613 microversion: 2.20 time: 0.100800 Nov 23 09:00:25.494191 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 167/306] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:00:25 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 28613 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 09:00:25.524382 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-fb355d97-b63f-4bc3-b157-d00e8c02338a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:25.533634 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-fb355d97-b63f-4bc3-b157-d00e8c02338a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1520 microversion: 2.1 time: 0.165549 Nov 23 09:00:25.538515 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 140/307] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:25 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:25.752905 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-456c212d-8e0c-497a-964a-fb28b7b9d281 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "376f5c37-c431-442c-8478-55093ffc860a"}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:25.754058 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-456c212d-8e0c-497a-964a-fb28b7b9d281 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 280ce860-8611-44bc-9aa5-0409d2e36937] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:25.760690 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-456c212d-8e0c-497a-964a-fb28b7b9d281 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:25.761137 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-456c212d-8e0c-497a-964a-fb28b7b9d281 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:25.761964 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-456c212d-8e0c-497a-964a-fb28b7b9d281 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:25.762437 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-456c212d-8e0c-497a-964a-fb28b7b9d281 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:25.843869 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-456c212d-8e0c-497a-964a-fb28b7b9d281 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] HTTP exception thrown: Invalid volume: volume 376f5c37-c431-442c-8478-55093ffc860a is already attached to instances: 280ce860-8611-44bc-9aa5-0409d2e36937 Nov 23 09:00:25.844599 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-456c212d-8e0c-497a-964a-fb28b7b9d281 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Returning 400 to user: Invalid volume: volume 376f5c37-c431-442c-8478-55093ffc860a is already attached to instances: 280ce860-8611-44bc-9aa5-0409d2e36937 {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 09:00:25.845561 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-456c212d-8e0c-497a-964a-fb28b7b9d281 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "POST /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097683 Nov 23 09:00:25.846153 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 168/308] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 23 09:00:25 2021] POST /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 23 09:00:25.903198 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-062ee403-d967-47fb-979c-93c10aeb01f3 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:25.903684 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-062ee403-d967-47fb-979c-93c10aeb01f3 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 280ce860-8611-44bc-9aa5-0409d2e36937] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:25.909898 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-062ee403-d967-47fb-979c-93c10aeb01f3 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:25.910341 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-062ee403-d967-47fb-979c-93c10aeb01f3 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:25.911112 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-062ee403-d967-47fb-979c-93c10aeb01f3 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:25.911568 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-062ee403-d967-47fb-979c-93c10aeb01f3 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:26.032729 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.objects.instance [None req-062ee403-d967-47fb-979c-93c10aeb01f3 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lazy-loading 'services' on Instance uuid 280ce860-8611-44bc-9aa5-0409d2e36937 {{(pid=116227) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 09:00:26.147245 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-062ee403-d967-47fb-979c-93c10aeb01f3 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "DELETE /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937/os-volume_attachments/376f5c37-c431-442c-8478-55093ffc860a" status: 202 len: 0 microversion: 2.1 time: 0.247520 Nov 23 09:00:26.148012 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 141/309] 10.222.0.46 () {58 vars in 1415 bytes} [Tue Nov 23 09:00:25 2021] DELETE /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937/os-volume_attachments/376f5c37-c431-442c-8478-55093ffc860a => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:00:26.156776 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-20c219cd-a916-43e7-8a06-4a16a31ee354 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:26.157858 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-20c219cd-a916-43e7-8a06-4a16a31ee354 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 280ce860-8611-44bc-9aa5-0409d2e36937] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:26.164860 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-20c219cd-a916-43e7-8a06-4a16a31ee354 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:26.165328 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-20c219cd-a916-43e7-8a06-4a16a31ee354 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:26.166112 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-20c219cd-a916-43e7-8a06-4a16a31ee354 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:26.166557 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-20c219cd-a916-43e7-8a06-4a16a31ee354 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:26.196786 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-20c219cd-a916-43e7-8a06-4a16a31ee354 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044308 Nov 23 09:00:26.197379 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 169/310] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 23 09:00:26 2021] GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:00:26.506649 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-762b79c5-00e4-4adc-bd85-63fcdcfaed93 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:26.507633 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-762b79c5-00e4-4adc-bd85-63fcdcfaed93 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:26.514411 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-762b79c5-00e4-4adc-bd85-63fcdcfaed93 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:26.514904 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-762b79c5-00e4-4adc-bd85-63fcdcfaed93 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:26.515675 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-762b79c5-00e4-4adc-bd85-63fcdcfaed93 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:26.516137 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-762b79c5-00e4-4adc-bd85-63fcdcfaed93 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:26.551586 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-7244934e-8297-46dd-a225-e2f7e161708f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:26.552166 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-7244934e-8297-46dd-a225-e2f7e161708f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:26.558383 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7244934e-8297-46dd-a225-e2f7e161708f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:26.558830 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7244934e-8297-46dd-a225-e2f7e161708f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:26.559596 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7244934e-8297-46dd-a225-e2f7e161708f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:26.560027 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7244934e-8297-46dd-a225-e2f7e161708f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:26.592741 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-762b79c5-00e4-4adc-bd85-63fcdcfaed93 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 28613 microversion: 2.20 time: 0.089582 Nov 23 09:00:26.593684 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 142/311] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:00:26 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 28613 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:00:26.693840 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-7244934e-8297-46dd-a225-e2f7e161708f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:26.702227 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-7244934e-8297-46dd-a225-e2f7e161708f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1520 microversion: 2.1 time: 0.153910 Nov 23 09:00:26.703044 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 170/312] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:26 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:00:27.208784 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-d82dea5d-596b-4203-a7c3-d7e050140e54 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:27.209809 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-d82dea5d-596b-4203-a7c3-d7e050140e54 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 280ce860-8611-44bc-9aa5-0409d2e36937] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:27.216609 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d82dea5d-596b-4203-a7c3-d7e050140e54 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:27.217060 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d82dea5d-596b-4203-a7c3-d7e050140e54 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:27.218163 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d82dea5d-596b-4203-a7c3-d7e050140e54 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:27.218628 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d82dea5d-596b-4203-a7c3-d7e050140e54 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:27.250779 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-d82dea5d-596b-4203-a7c3-d7e050140e54 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045951 Nov 23 09:00:27.251518 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 143/313] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 23 09:00:27 2021] GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:00:27.604578 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a3b2ce2b-5387-4423-b380-482a2f277875 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:27.605524 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a3b2ce2b-5387-4423-b380-482a2f277875 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:27.612454 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a3b2ce2b-5387-4423-b380-482a2f277875 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:27.612910 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a3b2ce2b-5387-4423-b380-482a2f277875 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:27.613729 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a3b2ce2b-5387-4423-b380-482a2f277875 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:27.614209 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a3b2ce2b-5387-4423-b380-482a2f277875 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:27.686309 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a3b2ce2b-5387-4423-b380-482a2f277875 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 28613 microversion: 2.20 time: 0.084443 Nov 23 09:00:27.687448 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 171/314] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:00:27 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 28613 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:00:27.719643 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-56617edf-be07-4a46-9e18-298870e6c742 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:27.720243 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-56617edf-be07-4a46-9e18-298870e6c742 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:27.727041 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-56617edf-be07-4a46-9e18-298870e6c742 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:27.727505 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-56617edf-be07-4a46-9e18-298870e6c742 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:27.728313 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-56617edf-be07-4a46-9e18-298870e6c742 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:27.728780 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-56617edf-be07-4a46-9e18-298870e6c742 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:27.861951 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-56617edf-be07-4a46-9e18-298870e6c742 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:27.869499 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-56617edf-be07-4a46-9e18-298870e6c742 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1520 microversion: 2.1 time: 0.154218 Nov 23 09:00:27.870096 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 144/315] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:27 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:28.262663 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-ca3f16bf-a169-493e-abb7-60a05d118ca7 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:28.264560 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-ca3f16bf-a169-493e-abb7-60a05d118ca7 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 280ce860-8611-44bc-9aa5-0409d2e36937] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:28.272380 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ca3f16bf-a169-493e-abb7-60a05d118ca7 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:28.272925 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ca3f16bf-a169-493e-abb7-60a05d118ca7 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:28.273840 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ca3f16bf-a169-493e-abb7-60a05d118ca7 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:28.274485 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ca3f16bf-a169-493e-abb7-60a05d118ca7 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:28.308088 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-ca3f16bf-a169-493e-abb7-60a05d118ca7 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049533 Nov 23 09:00:28.308657 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 172/316] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 23 09:00:28 2021] GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:00:28.697685 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-70a44b01-dd95-4505-b756-667cbd72675a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:28.698710 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-70a44b01-dd95-4505-b756-667cbd72675a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:28.705920 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-70a44b01-dd95-4505-b756-667cbd72675a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:28.706380 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-70a44b01-dd95-4505-b756-667cbd72675a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:28.707162 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-70a44b01-dd95-4505-b756-667cbd72675a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:28.707633 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-70a44b01-dd95-4505-b756-667cbd72675a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:28.788918 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-70a44b01-dd95-4505-b756-667cbd72675a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 28613 microversion: 2.20 time: 0.094564 Nov 23 09:00:28.789873 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 145/317] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:00:28 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 28613 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:00:28.887535 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b27ea325-6e93-417e-a157-321c5764ef63 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:28.888129 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b27ea325-6e93-417e-a157-321c5764ef63 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:28.894583 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b27ea325-6e93-417e-a157-321c5764ef63 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:28.895031 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b27ea325-6e93-417e-a157-321c5764ef63 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:28.895827 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b27ea325-6e93-417e-a157-321c5764ef63 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:28.896261 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b27ea325-6e93-417e-a157-321c5764ef63 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:29.032631 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b27ea325-6e93-417e-a157-321c5764ef63 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:29.040629 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b27ea325-6e93-417e-a157-321c5764ef63 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1520 microversion: 2.1 time: 0.156651 Nov 23 09:00:29.041248 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 173/318] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:28 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:29.320202 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-d192c434-6cde-4865-a4db-17ed73bb9274 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:29.321203 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-d192c434-6cde-4865-a4db-17ed73bb9274 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 280ce860-8611-44bc-9aa5-0409d2e36937] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:29.329155 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d192c434-6cde-4865-a4db-17ed73bb9274 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:29.329497 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d192c434-6cde-4865-a4db-17ed73bb9274 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:29.330300 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d192c434-6cde-4865-a4db-17ed73bb9274 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:29.330758 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d192c434-6cde-4865-a4db-17ed73bb9274 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:29.361660 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-d192c434-6cde-4865-a4db-17ed73bb9274 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045712 Nov 23 09:00:29.362236 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 146/319] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 23 09:00:29 2021] GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:00:29.801153 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-eca53f30-0a51-4a74-bc44-04ab07cc2226 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:29.802109 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-eca53f30-0a51-4a74-bc44-04ab07cc2226 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:29.808209 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-eca53f30-0a51-4a74-bc44-04ab07cc2226 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:29.808666 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-eca53f30-0a51-4a74-bc44-04ab07cc2226 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:29.809538 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-eca53f30-0a51-4a74-bc44-04ab07cc2226 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:29.809986 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-eca53f30-0a51-4a74-bc44-04ab07cc2226 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:29.876276 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-eca53f30-0a51-4a74-bc44-04ab07cc2226 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 28613 microversion: 2.20 time: 0.078727 Nov 23 09:00:29.876921 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 174/320] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:00:29 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 28613 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:00:30.058366 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-0d169345-ca6d-4d96-8adc-3a8849ecb941 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:30.058899 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-0d169345-ca6d-4d96-8adc-3a8849ecb941 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:30.065883 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0d169345-ca6d-4d96-8adc-3a8849ecb941 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:30.066331 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0d169345-ca6d-4d96-8adc-3a8849ecb941 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:30.067099 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0d169345-ca6d-4d96-8adc-3a8849ecb941 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:30.067527 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0d169345-ca6d-4d96-8adc-3a8849ecb941 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:30.205133 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-0d169345-ca6d-4d96-8adc-3a8849ecb941 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:30.212467 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-0d169345-ca6d-4d96-8adc-3a8849ecb941 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1520 microversion: 2.1 time: 0.157877 Nov 23 09:00:30.213026 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 147/321] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:30 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:30.374931 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-343f3a7c-f917-4dff-b77b-e2f0d2810bae tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:30.375904 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-343f3a7c-f917-4dff-b77b-e2f0d2810bae tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 280ce860-8611-44bc-9aa5-0409d2e36937] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:30.383158 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-343f3a7c-f917-4dff-b77b-e2f0d2810bae tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:30.383608 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-343f3a7c-f917-4dff-b77b-e2f0d2810bae tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:30.384403 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-343f3a7c-f917-4dff-b77b-e2f0d2810bae tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:30.384834 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-343f3a7c-f917-4dff-b77b-e2f0d2810bae tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:30.416252 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-343f3a7c-f917-4dff-b77b-e2f0d2810bae tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045987 Nov 23 09:00:30.416816 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 175/322] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 23 09:00:30 2021] GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:00:30.886989 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-1c318b76-7a47-451f-ba9c-63252e4556fb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:30.887898 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-1c318b76-7a47-451f-ba9c-63252e4556fb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:30.895064 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1c318b76-7a47-451f-ba9c-63252e4556fb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:30.895533 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1c318b76-7a47-451f-ba9c-63252e4556fb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:30.896299 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1c318b76-7a47-451f-ba9c-63252e4556fb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:30.896757 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1c318b76-7a47-451f-ba9c-63252e4556fb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:30.988358 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-1c318b76-7a47-451f-ba9c-63252e4556fb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 29337 microversion: 2.20 time: 0.104938 Nov 23 09:00:30.989033 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 148/323] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:00:30 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 29337 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:00:31.229080 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-577715c0-94cd-4da7-b17d-186c5bc4b29f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:31.229742 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-577715c0-94cd-4da7-b17d-186c5bc4b29f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:31.236957 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-577715c0-94cd-4da7-b17d-186c5bc4b29f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:31.237929 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-577715c0-94cd-4da7-b17d-186c5bc4b29f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:31.238912 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-577715c0-94cd-4da7-b17d-186c5bc4b29f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:31.239358 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-577715c0-94cd-4da7-b17d-186c5bc4b29f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:31.428139 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-8907c23a-0ce1-4b5c-ac8e-8dc70567907d tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:31.429128 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-8907c23a-0ce1-4b5c-ac8e-8dc70567907d tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 280ce860-8611-44bc-9aa5-0409d2e36937] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:31.436613 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8907c23a-0ce1-4b5c-ac8e-8dc70567907d tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:31.437065 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8907c23a-0ce1-4b5c-ac8e-8dc70567907d tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:31.437869 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8907c23a-0ce1-4b5c-ac8e-8dc70567907d tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:31.438309 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8907c23a-0ce1-4b5c-ac8e-8dc70567907d tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:31.471593 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-8907c23a-0ce1-4b5c-ac8e-8dc70567907d tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047443 Nov 23 09:00:31.472167 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 149/324] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 23 09:00:31 2021] GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 09:00:31.511465 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-577715c0-94cd-4da7-b17d-186c5bc4b29f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:31.519787 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-577715c0-94cd-4da7-b17d-186c5bc4b29f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1520 microversion: 2.1 time: 0.294380 Nov 23 09:00:31.520343 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 176/325] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:31 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1520 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:32.001973 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-28d417d5-e5d1-4d57-b246-383c2cf87314 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:32.003380 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-28d417d5-e5d1-4d57-b246-383c2cf87314 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:32.014116 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-28d417d5-e5d1-4d57-b246-383c2cf87314 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:32.014116 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-28d417d5-e5d1-4d57-b246-383c2cf87314 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:32.014116 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-28d417d5-e5d1-4d57-b246-383c2cf87314 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:32.014116 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-28d417d5-e5d1-4d57-b246-383c2cf87314 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:32.108318 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-28d417d5-e5d1-4d57-b246-383c2cf87314 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 30169 microversion: 2.20 time: 0.111802 Nov 23 09:00:32.109208 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 150/326] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:00:31 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 30169 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:00:32.483129 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-4089e2a9-3ca8-4c15-8453-ff92975d1d12 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:32.484034 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-4089e2a9-3ca8-4c15-8453-ff92975d1d12 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 280ce860-8611-44bc-9aa5-0409d2e36937] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:32.490505 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4089e2a9-3ca8-4c15-8453-ff92975d1d12 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:32.490955 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4089e2a9-3ca8-4c15-8453-ff92975d1d12 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:32.491725 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4089e2a9-3ca8-4c15-8453-ff92975d1d12 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:32.492159 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4089e2a9-3ca8-4c15-8453-ff92975d1d12 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:32.523598 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-4089e2a9-3ca8-4c15-8453-ff92975d1d12 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044441 Nov 23 09:00:32.524303 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 177/327] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 23 09:00:32 2021] GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:00:32.537484 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-b41c9232-9bd0-4b4a-a13a-09cae48dc3ea tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:32.538273 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-b41c9232-9bd0-4b4a-a13a-09cae48dc3ea tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:32.545914 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b41c9232-9bd0-4b4a-a13a-09cae48dc3ea tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:32.546378 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b41c9232-9bd0-4b4a-a13a-09cae48dc3ea tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:32.547163 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b41c9232-9bd0-4b4a-a13a-09cae48dc3ea tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:32.547597 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b41c9232-9bd0-4b4a-a13a-09cae48dc3ea tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:32.680489 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-b41c9232-9bd0-4b4a-a13a-09cae48dc3ea tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:32.688267 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-b41c9232-9bd0-4b4a-a13a-09cae48dc3ea tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1520 microversion: 2.1 time: 0.154758 Nov 23 09:00:32.688845 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 151/328] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:32 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:00:33.119957 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-0ba2015a-d3df-46e8-8c1a-d328c92c7b51 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:33.120883 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-0ba2015a-d3df-46e8-8c1a-d328c92c7b51 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:33.127382 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ba2015a-d3df-46e8-8c1a-d328c92c7b51 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:33.127842 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ba2015a-d3df-46e8-8c1a-d328c92c7b51 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:33.128651 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ba2015a-d3df-46e8-8c1a-d328c92c7b51 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:33.129039 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ba2015a-d3df-46e8-8c1a-d328c92c7b51 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:33.535582 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-67ba4bad-e4af-4b08-b1e0-cd158a497ac4 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:33.536500 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-67ba4bad-e4af-4b08-b1e0-cd158a497ac4 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 280ce860-8611-44bc-9aa5-0409d2e36937] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:33.542691 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-67ba4bad-e4af-4b08-b1e0-cd158a497ac4 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:33.543260 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-67ba4bad-e4af-4b08-b1e0-cd158a497ac4 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:33.543895 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-67ba4bad-e4af-4b08-b1e0-cd158a497ac4 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:33.544381 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-67ba4bad-e4af-4b08-b1e0-cd158a497ac4 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:33.572232 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-67ba4bad-e4af-4b08-b1e0-cd158a497ac4 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040397 Nov 23 09:00:33.572775 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 152/329] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 23 09:00:33 2021] GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 09:00:33.705750 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-4e56e8d7-42dc-4b29-baba-94aa677921e9 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:33.706274 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-4e56e8d7-42dc-4b29-baba-94aa677921e9 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:33.712092 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4e56e8d7-42dc-4b29-baba-94aa677921e9 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:33.712540 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4e56e8d7-42dc-4b29-baba-94aa677921e9 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:33.713337 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4e56e8d7-42dc-4b29-baba-94aa677921e9 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:33.713771 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4e56e8d7-42dc-4b29-baba-94aa677921e9 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:33.844795 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-4e56e8d7-42dc-4b29-baba-94aa677921e9 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:33.852119 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-4e56e8d7-42dc-4b29-baba-94aa677921e9 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1520 microversion: 2.1 time: 0.149957 Nov 23 09:00:33.852692 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 153/330] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:33 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:34.583722 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-7c72a4a1-5c3a-4b6f-860b-502a84ddb46a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:34.584625 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-7c72a4a1-5c3a-4b6f-860b-502a84ddb46a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 280ce860-8611-44bc-9aa5-0409d2e36937] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:34.590937 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7c72a4a1-5c3a-4b6f-860b-502a84ddb46a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:34.591868 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7c72a4a1-5c3a-4b6f-860b-502a84ddb46a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:34.592898 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7c72a4a1-5c3a-4b6f-860b-502a84ddb46a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:34.593369 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7c72a4a1-5c3a-4b6f-860b-502a84ddb46a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:34.621621 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-7c72a4a1-5c3a-4b6f-860b-502a84ddb46a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041552 Nov 23 09:00:34.622162 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 154/331] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 23 09:00:34 2021] GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 09:00:34.868339 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-4292fa65-330e-4fa5-bcbc-ca20a2618b8c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:34.868862 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-4292fa65-330e-4fa5-bcbc-ca20a2618b8c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:34.876715 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4292fa65-330e-4fa5-bcbc-ca20a2618b8c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:34.877202 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4292fa65-330e-4fa5-bcbc-ca20a2618b8c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:34.878016 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4292fa65-330e-4fa5-bcbc-ca20a2618b8c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:34.878461 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4292fa65-330e-4fa5-bcbc-ca20a2618b8c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:35.009779 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-4292fa65-330e-4fa5-bcbc-ca20a2618b8c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:35.017684 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-4292fa65-330e-4fa5-bcbc-ca20a2618b8c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1520 microversion: 2.1 time: 0.153094 Nov 23 09:00:35.018258 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 155/332] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:34 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:00:35.633041 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-17a59410-5636-4921-b7db-b03cb6edb2c0 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:35.633969 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-17a59410-5636-4921-b7db-b03cb6edb2c0 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 280ce860-8611-44bc-9aa5-0409d2e36937] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:35.640945 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-17a59410-5636-4921-b7db-b03cb6edb2c0 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:35.641368 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-17a59410-5636-4921-b7db-b03cb6edb2c0 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:35.642142 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-17a59410-5636-4921-b7db-b03cb6edb2c0 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:35.642573 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-17a59410-5636-4921-b7db-b03cb6edb2c0 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:35.670181 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-17a59410-5636-4921-b7db-b03cb6edb2c0 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040824 Nov 23 09:00:35.670725 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 156/333] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 23 09:00:35 2021] GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 09:00:35.750087 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-0ba2015a-d3df-46e8-8c1a-d328c92c7b51 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 33265 microversion: 2.20 time: 2.633726 Nov 23 09:00:35.750820 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 178/334] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:00:33 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 33265 bytes in 2635 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:00:36.034919 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-419e1aca-d7e8-4da6-a525-c4b5c97f51a9 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:36.035587 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-419e1aca-d7e8-4da6-a525-c4b5c97f51a9 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:36.041886 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-419e1aca-d7e8-4da6-a525-c4b5c97f51a9 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:36.042346 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-419e1aca-d7e8-4da6-a525-c4b5c97f51a9 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:36.043134 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-419e1aca-d7e8-4da6-a525-c4b5c97f51a9 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:36.043576 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-419e1aca-d7e8-4da6-a525-c4b5c97f51a9 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:36.180558 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-419e1aca-d7e8-4da6-a525-c4b5c97f51a9 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:36.188497 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-419e1aca-d7e8-4da6-a525-c4b5c97f51a9 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1520 microversion: 2.1 time: 0.157588 Nov 23 09:00:36.189070 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 157/335] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:36 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:36.682605 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b71f7309-a62f-42b1-8d34-cfd6ae07cb19 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:36.683816 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b71f7309-a62f-42b1-8d34-cfd6ae07cb19 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 280ce860-8611-44bc-9aa5-0409d2e36937] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:36.691811 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b71f7309-a62f-42b1-8d34-cfd6ae07cb19 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:36.692272 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b71f7309-a62f-42b1-8d34-cfd6ae07cb19 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:36.693064 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b71f7309-a62f-42b1-8d34-cfd6ae07cb19 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:36.693532 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b71f7309-a62f-42b1-8d34-cfd6ae07cb19 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:36.725649 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b71f7309-a62f-42b1-8d34-cfd6ae07cb19 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046201 Nov 23 09:00:36.726226 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 179/336] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 23 09:00:36 2021] GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 09:00:36.761113 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-5a13a02d-5e80-4379-b6bc-55acaccbaad3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:36.762056 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-5a13a02d-5e80-4379-b6bc-55acaccbaad3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:36.768491 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5a13a02d-5e80-4379-b6bc-55acaccbaad3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:36.768955 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5a13a02d-5e80-4379-b6bc-55acaccbaad3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:36.770068 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5a13a02d-5e80-4379-b6bc-55acaccbaad3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:36.770692 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5a13a02d-5e80-4379-b6bc-55acaccbaad3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:36.865582 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-5a13a02d-5e80-4379-b6bc-55acaccbaad3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 33522 microversion: 2.20 time: 0.107943 Nov 23 09:00:36.869658 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 158/337] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:00:36 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 33522 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:00:36.886078 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a4aafa87-fe13-422b-9a8b-421a59c9f983 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-658398000", "imageRef": "18424a16-ac32-42d5-8161-d6cb36423de3", "flavorRef": "452", "networks": [{"uuid": "90165a93-ecd4-4624-b7b5-1b5c85ea25bb"}]}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:36.939064 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.network.neutron [None req-a4aafa87-fe13-422b-9a8b-421a59c9f983 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] validate_networks() for [('90165a93-ecd4-4624-b7b5-1b5c85ea25bb', None, None, None, None, None)] {{(pid=116226) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 09:00:37.207517 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-610a9d0e-f439-4cb9-950f-c4ef6a8d11aa tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:37.208119 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-610a9d0e-f439-4cb9-950f-c4ef6a8d11aa tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:37.214926 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-610a9d0e-f439-4cb9-950f-c4ef6a8d11aa tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:37.215372 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-610a9d0e-f439-4cb9-950f-c4ef6a8d11aa tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:37.216180 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-610a9d0e-f439-4cb9-950f-c4ef6a8d11aa tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:37.216610 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-610a9d0e-f439-4cb9-950f-c4ef6a8d11aa tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:37.309418 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-a4aafa87-fe13-422b-9a8b-421a59c9f983 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Flavor limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 09:00:37.310547 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-a4aafa87-fe13-422b-9a8b-421a59c9f983 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Image limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 09:00:37.311026 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-a4aafa87-fe13-422b-9a8b-421a59c9f983 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Flavor pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 09:00:37.311464 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-a4aafa87-fe13-422b-9a8b-421a59c9f983 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Image pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 09:00:37.311875 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-a4aafa87-fe13-422b-9a8b-421a59c9f983 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 09:00:37.321366 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a4aafa87-fe13-422b-9a8b-421a59c9f983 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:37.321820 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a4aafa87-fe13-422b-9a8b-421a59c9f983 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:37.322637 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a4aafa87-fe13-422b-9a8b-421a59c9f983 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:37.323074 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a4aafa87-fe13-422b-9a8b-421a59c9f983 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:37.341897 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-a4aafa87-fe13-422b-9a8b-421a59c9f983 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Getting quotas for project 82f534070f974dc882ad415be1a1d3ef. Resources: {'instances', 'ram', 'cores'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 09:00:37.346226 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-a4aafa87-fe13-422b-9a8b-421a59c9f983 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Getting quotas for user 0642f1d3e0da400ebba9d029f63a95ce and project 82f534070f974dc882ad415be1a1d3ef. Resources: {'instances', 'ram', 'cores'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 09:00:37.357799 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a4aafa87-fe13-422b-9a8b-421a59c9f983 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Going to run 1 instances... {{(pid=116226) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 09:00:37.360496 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a4aafa87-fe13-422b-9a8b-421a59c9f983 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 468f160d-19b7-4d4c-a51a-a74c32cc4d75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='18424a16-ac32-42d5-8161-d6cb36423de3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116226) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 09:00:37.407386 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a4aafa87-fe13-422b-9a8b-421a59c9f983 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.524774 Nov 23 09:00:37.408348 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 180/338] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 23 09:00:36 2021] POST /compute/v2.1/servers => generated 380 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 09:00:37.418338 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-174dde68-8316-4cf0-8710-c9ab3abbb538 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:37.419876 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-174dde68-8316-4cf0-8710-c9ab3abbb538 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 468f160d-19b7-4d4c-a51a-a74c32cc4d75] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:37.483828 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-174dde68-8316-4cf0-8710-c9ab3abbb538 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:37.494637 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-174dde68-8316-4cf0-8710-c9ab3abbb538 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75" status: 200 len: 1217 microversion: 2.1 time: 0.080148 Nov 23 09:00:37.495210 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 181/339] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:37 2021] GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75 => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:00:37.525004 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-610a9d0e-f439-4cb9-950f-c4ef6a8d11aa tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:37.534840 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-610a9d0e-f439-4cb9-950f-c4ef6a8d11aa tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1520 microversion: 2.1 time: 0.331400 Nov 23 09:00:37.535406 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 159/340] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:37 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1520 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:00:37.878439 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-40930fe0-4c7e-4ffe-8469-cb790eebd99f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:37.879444 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-40930fe0-4c7e-4ffe-8469-cb790eebd99f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:37.887299 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-40930fe0-4c7e-4ffe-8469-cb790eebd99f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:37.887976 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-40930fe0-4c7e-4ffe-8469-cb790eebd99f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:37.888572 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-40930fe0-4c7e-4ffe-8469-cb790eebd99f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:37.889045 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-40930fe0-4c7e-4ffe-8469-cb790eebd99f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:38.511966 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-0e5169fe-8d48-45b7-b0ef-86afe08535d1 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:38.512502 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-0e5169fe-8d48-45b7-b0ef-86afe08535d1 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 468f160d-19b7-4d4c-a51a-a74c32cc4d75] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:38.519427 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0e5169fe-8d48-45b7-b0ef-86afe08535d1 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:38.519875 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0e5169fe-8d48-45b7-b0ef-86afe08535d1 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:38.520656 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0e5169fe-8d48-45b7-b0ef-86afe08535d1 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:38.521093 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0e5169fe-8d48-45b7-b0ef-86afe08535d1 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:38.580681 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-0e5169fe-8d48-45b7-b0ef-86afe08535d1 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:38.587768 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-0e5169fe-8d48-45b7-b0ef-86afe08535d1 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75" status: 200 len: 1221 microversion: 2.1 time: 0.079545 Nov 23 09:00:38.588317 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 160/341] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:38 2021] GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75 => generated 1221 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:00:38.597285 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-8b23f01b-14d3-45fb-9436-853f99c6fd9a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:38.597911 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-8b23f01b-14d3-45fb-9436-853f99c6fd9a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:38.603346 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8b23f01b-14d3-45fb-9436-853f99c6fd9a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:38.603795 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8b23f01b-14d3-45fb-9436-853f99c6fd9a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:38.604568 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8b23f01b-14d3-45fb-9436-853f99c6fd9a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:38.605003 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8b23f01b-14d3-45fb-9436-853f99c6fd9a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:38.735124 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-8b23f01b-14d3-45fb-9436-853f99c6fd9a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:38.742327 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-8b23f01b-14d3-45fb-9436-853f99c6fd9a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1520 microversion: 2.1 time: 0.148452 Nov 23 09:00:38.742895 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 161/342] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:38 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:39.605198 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-e9f6924e-d51e-4d8c-87ba-d59b798edc62 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:39.607045 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-e9f6924e-d51e-4d8c-87ba-d59b798edc62 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 468f160d-19b7-4d4c-a51a-a74c32cc4d75] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:39.613461 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e9f6924e-d51e-4d8c-87ba-d59b798edc62 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:39.613915 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e9f6924e-d51e-4d8c-87ba-d59b798edc62 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:39.614698 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e9f6924e-d51e-4d8c-87ba-d59b798edc62 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:39.615135 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e9f6924e-d51e-4d8c-87ba-d59b798edc62 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:39.676262 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-e9f6924e-d51e-4d8c-87ba-d59b798edc62 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:39.683382 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-e9f6924e-d51e-4d8c-87ba-d59b798edc62 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75" status: 200 len: 1221 microversion: 2.1 time: 0.081880 Nov 23 09:00:39.683944 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 162/343] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:39 2021] GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75 => generated 1221 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:00:39.758821 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-1f2c2eba-a977-411c-9163-e90b0fa348fc tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:39.759415 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-1f2c2eba-a977-411c-9163-e90b0fa348fc tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:39.765507 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1f2c2eba-a977-411c-9163-e90b0fa348fc tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:39.765966 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1f2c2eba-a977-411c-9163-e90b0fa348fc tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:39.766731 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1f2c2eba-a977-411c-9163-e90b0fa348fc tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:39.767170 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1f2c2eba-a977-411c-9163-e90b0fa348fc tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:39.897756 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-1f2c2eba-a977-411c-9163-e90b0fa348fc tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:39.905125 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-1f2c2eba-a977-411c-9163-e90b0fa348fc tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1520 microversion: 2.1 time: 0.149958 Nov 23 09:00:39.905723 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 163/344] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:39 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:00:40.164222 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-40930fe0-4c7e-4ffe-8469-cb790eebd99f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 36164 microversion: 2.20 time: 2.290191 Nov 23 09:00:40.165094 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 182/345] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:00:37 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 36164 bytes in 2292 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 09:00:40.701925 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-f318f540-0513-4fd6-ac21-cce3cf46a14c tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:40.702556 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-f318f540-0513-4fd6-ac21-cce3cf46a14c tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 468f160d-19b7-4d4c-a51a-a74c32cc4d75] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:40.709512 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f318f540-0513-4fd6-ac21-cce3cf46a14c tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:40.709900 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f318f540-0513-4fd6-ac21-cce3cf46a14c tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:40.710722 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f318f540-0513-4fd6-ac21-cce3cf46a14c tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:40.711164 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f318f540-0513-4fd6-ac21-cce3cf46a14c tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:40.785615 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-f318f540-0513-4fd6-ac21-cce3cf46a14c tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:40.794730 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-f318f540-0513-4fd6-ac21-cce3cf46a14c tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75" status: 200 len: 1269 microversion: 2.1 time: 0.097192 Nov 23 09:00:40.805103 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 164/346] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:40 2021] GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75 => generated 1269 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:40.923053 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-047dff76-752d-41a9-8d43-f29bcbe7a987 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:40.924006 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-047dff76-752d-41a9-8d43-f29bcbe7a987 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:40.931816 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-047dff76-752d-41a9-8d43-f29bcbe7a987 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:40.932720 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-047dff76-752d-41a9-8d43-f29bcbe7a987 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:40.933782 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-047dff76-752d-41a9-8d43-f29bcbe7a987 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:40.934286 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-047dff76-752d-41a9-8d43-f29bcbe7a987 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:41.094673 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-047dff76-752d-41a9-8d43-f29bcbe7a987 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:41.102594 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-047dff76-752d-41a9-8d43-f29bcbe7a987 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1520 microversion: 2.1 time: 0.184279 Nov 23 09:00:41.103172 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 183/347] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:40 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:41.175850 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-d85235a1-3f15-45ac-8414-4dc25daae54c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:41.176821 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-d85235a1-3f15-45ac-8414-4dc25daae54c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:41.182727 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d85235a1-3f15-45ac-8414-4dc25daae54c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:41.183179 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d85235a1-3f15-45ac-8414-4dc25daae54c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:41.183957 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d85235a1-3f15-45ac-8414-4dc25daae54c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:41.184393 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d85235a1-3f15-45ac-8414-4dc25daae54c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:41.293741 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-d85235a1-3f15-45ac-8414-4dc25daae54c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 36458 microversion: 2.20 time: 0.121363 Nov 23 09:00:41.295057 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 165/348] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:00:41 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 36458 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:00:41.812821 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-2cd473f8-43ca-44cb-aa49-45a086b88e40 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:41.813447 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-2cd473f8-43ca-44cb-aa49-45a086b88e40 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 468f160d-19b7-4d4c-a51a-a74c32cc4d75] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:41.819565 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2cd473f8-43ca-44cb-aa49-45a086b88e40 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:41.820016 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2cd473f8-43ca-44cb-aa49-45a086b88e40 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:41.820784 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2cd473f8-43ca-44cb-aa49-45a086b88e40 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:41.821245 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2cd473f8-43ca-44cb-aa49-45a086b88e40 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:41.951657 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-2cd473f8-43ca-44cb-aa49-45a086b88e40 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:41.959022 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-2cd473f8-43ca-44cb-aa49-45a086b88e40 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75" status: 200 len: 1317 microversion: 2.1 time: 0.150524 Nov 23 09:00:41.959643 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 184/349] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:41 2021] GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:42.120258 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-7e294f90-c306-4d3e-a3c1-8edaafe182e6 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:42.120961 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-7e294f90-c306-4d3e-a3c1-8edaafe182e6 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:42.128473 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7e294f90-c306-4d3e-a3c1-8edaafe182e6 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:42.128930 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7e294f90-c306-4d3e-a3c1-8edaafe182e6 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:42.129755 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7e294f90-c306-4d3e-a3c1-8edaafe182e6 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:42.130188 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7e294f90-c306-4d3e-a3c1-8edaafe182e6 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:42.277074 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-7e294f90-c306-4d3e-a3c1-8edaafe182e6 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:42.285496 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-7e294f90-c306-4d3e-a3c1-8edaafe182e6 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1520 microversion: 2.1 time: 0.169067 Nov 23 09:00:42.286061 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 166/350] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:42 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:42.305016 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f922f552-8048-407e-963b-4eed18fd1f08 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:42.306006 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f922f552-8048-407e-963b-4eed18fd1f08 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:42.312909 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f922f552-8048-407e-963b-4eed18fd1f08 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:42.313398 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f922f552-8048-407e-963b-4eed18fd1f08 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:42.314172 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f922f552-8048-407e-963b-4eed18fd1f08 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:42.314609 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f922f552-8048-407e-963b-4eed18fd1f08 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:42.976904 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-0ed7a6e2-f4ba-4e64-99ad-150c5d5fcf13 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:42.977448 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-0ed7a6e2-f4ba-4e64-99ad-150c5d5fcf13 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 468f160d-19b7-4d4c-a51a-a74c32cc4d75] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:42.984363 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0ed7a6e2-f4ba-4e64-99ad-150c5d5fcf13 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:42.984804 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0ed7a6e2-f4ba-4e64-99ad-150c5d5fcf13 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:42.985593 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0ed7a6e2-f4ba-4e64-99ad-150c5d5fcf13 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:42.986030 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0ed7a6e2-f4ba-4e64-99ad-150c5d5fcf13 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:43.121349 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-0ed7a6e2-f4ba-4e64-99ad-150c5d5fcf13 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:43.129292 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-0ed7a6e2-f4ba-4e64-99ad-150c5d5fcf13 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75" status: 200 len: 1317 microversion: 2.1 time: 0.156037 Nov 23 09:00:43.129739 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 167/351] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:42 2021] GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:00:43.302994 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-5b12076b-1544-4c27-b390-418c45622c77 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:43.303599 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-5b12076b-1544-4c27-b390-418c45622c77 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:43.310153 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5b12076b-1544-4c27-b390-418c45622c77 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:43.310604 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5b12076b-1544-4c27-b390-418c45622c77 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:43.311411 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5b12076b-1544-4c27-b390-418c45622c77 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:43.311849 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5b12076b-1544-4c27-b390-418c45622c77 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:43.441800 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-5b12076b-1544-4c27-b390-418c45622c77 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:43.448948 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-5b12076b-1544-4c27-b390-418c45622c77 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1520 microversion: 2.1 time: 0.149660 Nov 23 09:00:43.449546 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 168/352] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:43 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:00:44.146463 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-44619f5b-77b3-41ab-a4d3-5cc9a98465dd tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:44.147068 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-44619f5b-77b3-41ab-a4d3-5cc9a98465dd tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 468f160d-19b7-4d4c-a51a-a74c32cc4d75] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:44.153404 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-44619f5b-77b3-41ab-a4d3-5cc9a98465dd tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:44.153853 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-44619f5b-77b3-41ab-a4d3-5cc9a98465dd tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:44.154619 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-44619f5b-77b3-41ab-a4d3-5cc9a98465dd tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:44.155055 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-44619f5b-77b3-41ab-a4d3-5cc9a98465dd tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:44.282357 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-44619f5b-77b3-41ab-a4d3-5cc9a98465dd tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:44.289630 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-44619f5b-77b3-41ab-a4d3-5cc9a98465dd tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75" status: 200 len: 1317 microversion: 2.1 time: 0.146831 Nov 23 09:00:44.290197 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 169/353] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:44 2021] GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75 => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:00:44.465539 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-0f89bea5-713c-4086-8131-f165e5f3cdbc tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:44.466602 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-0f89bea5-713c-4086-8131-f165e5f3cdbc tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:44.472894 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0f89bea5-713c-4086-8131-f165e5f3cdbc tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:44.473381 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0f89bea5-713c-4086-8131-f165e5f3cdbc tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:44.474165 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0f89bea5-713c-4086-8131-f165e5f3cdbc tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:44.474624 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0f89bea5-713c-4086-8131-f165e5f3cdbc tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:44.605635 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-0f89bea5-713c-4086-8131-f165e5f3cdbc tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:44.613720 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-0f89bea5-713c-4086-8131-f165e5f3cdbc tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1520 microversion: 2.1 time: 0.151887 Nov 23 09:00:44.614367 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 170/354] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:44 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:00:45.108969 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f922f552-8048-407e-963b-4eed18fd1f08 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 38054 microversion: 2.20 time: 2.807606 Nov 23 09:00:45.111996 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 185/355] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:00:42 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 38054 bytes in 2810 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 09:00:45.306746 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-2b94c028-eb95-45b4-847c-94809dbcd2fa tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:45.308127 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-2b94c028-eb95-45b4-847c-94809dbcd2fa tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 468f160d-19b7-4d4c-a51a-a74c32cc4d75] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:45.314987 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2b94c028-eb95-45b4-847c-94809dbcd2fa tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:45.315443 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2b94c028-eb95-45b4-847c-94809dbcd2fa tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:45.317839 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2b94c028-eb95-45b4-847c-94809dbcd2fa tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:45.318287 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2b94c028-eb95-45b4-847c-94809dbcd2fa tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:45.468514 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-2b94c028-eb95-45b4-847c-94809dbcd2fa tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:45.477826 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-2b94c028-eb95-45b4-847c-94809dbcd2fa tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75" status: 200 len: 1317 microversion: 2.1 time: 0.174562 Nov 23 09:00:45.478420 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 171/356] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:45 2021] GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:45.631445 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-10d99481-bf70-4a7e-bba4-4f566035fea8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:45.632136 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-10d99481-bf70-4a7e-bba4-4f566035fea8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:45.639742 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-10d99481-bf70-4a7e-bba4-4f566035fea8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:45.640193 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-10d99481-bf70-4a7e-bba4-4f566035fea8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:45.640979 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-10d99481-bf70-4a7e-bba4-4f566035fea8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:45.641435 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-10d99481-bf70-4a7e-bba4-4f566035fea8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:45.661609 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-66d50f10-9e4f-4702-a010-bcbd308eda3c req-1e75e5b5-bee8-44b5-a2a9-db62c2a1aa17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "468f160d-19b7-4d4c-a51a-a74c32cc4d75", "tag": "b57d2fa5-0e4c-480c-a153-ec9850be0754"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:45.664689 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:00:45.664689 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 09:00:45.672979 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-66d50f10-9e4f-4702-a010-bcbd308eda3c req-1e75e5b5-bee8-44b5-a2a9-db62c2a1aa17 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:45.674389 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-66d50f10-9e4f-4702-a010-bcbd308eda3c req-1e75e5b5-bee8-44b5-a2a9-db62c2a1aa17 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:45.688729 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-66d50f10-9e4f-4702-a010-bcbd308eda3c req-1e75e5b5-bee8-44b5-a2a9-db62c2a1aa17 service nova] Creating event network-changed:b57d2fa5-0e4c-480c-a153-ec9850be0754 for instance 468f160d-19b7-4d4c-a51a-a74c32cc4d75 on hv-cinder-76845 Nov 23 09:00:45.693593 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-66d50f10-9e4f-4702-a010-bcbd308eda3c req-1e75e5b5-bee8-44b5-a2a9-db62c2a1aa17 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036519 Nov 23 09:00:45.694325 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 172/357] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:00:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:00:45.830304 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-10d99481-bf70-4a7e-bba4-4f566035fea8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:45.849337 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-10d99481-bf70-4a7e-bba4-4f566035fea8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1520 microversion: 2.1 time: 0.221174 Nov 23 09:00:45.854123 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 186/358] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:45 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:46.123088 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-21f2659e-8436-435d-9d4e-d0337a3e3f38 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:46.124153 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-21f2659e-8436-435d-9d4e-d0337a3e3f38 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:46.130638 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-21f2659e-8436-435d-9d4e-d0337a3e3f38 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:46.131158 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-21f2659e-8436-435d-9d4e-d0337a3e3f38 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:46.131969 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-21f2659e-8436-435d-9d4e-d0337a3e3f38 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:46.132409 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-21f2659e-8436-435d-9d4e-d0337a3e3f38 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:46.263487 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-21f2659e-8436-435d-9d4e-d0337a3e3f38 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 38058 microversion: 2.20 time: 0.143925 Nov 23 09:00:46.272929 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 173/359] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:00:46 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 38058 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:00:46.494351 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b2ce7fd6-cb45-467b-9ea9-168df16f0d80 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:46.495507 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b2ce7fd6-cb45-467b-9ea9-168df16f0d80 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 468f160d-19b7-4d4c-a51a-a74c32cc4d75] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:46.502170 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b2ce7fd6-cb45-467b-9ea9-168df16f0d80 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:46.502628 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b2ce7fd6-cb45-467b-9ea9-168df16f0d80 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:46.503475 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b2ce7fd6-cb45-467b-9ea9-168df16f0d80 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:46.503926 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b2ce7fd6-cb45-467b-9ea9-168df16f0d80 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:46.737405 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b2ce7fd6-cb45-467b-9ea9-168df16f0d80 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:46.745196 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b2ce7fd6-cb45-467b-9ea9-168df16f0d80 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75" status: 200 len: 1317 microversion: 2.1 time: 0.254370 Nov 23 09:00:46.755003 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 187/360] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:46 2021] GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75 => generated 1317 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:46.867698 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-75f2c921-caaf-45fc-bb4d-1bde4d8cd081 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:46.868473 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-75f2c921-caaf-45fc-bb4d-1bde4d8cd081 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:46.876641 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-75f2c921-caaf-45fc-bb4d-1bde4d8cd081 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:46.877109 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-75f2c921-caaf-45fc-bb4d-1bde4d8cd081 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:46.878179 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-75f2c921-caaf-45fc-bb4d-1bde4d8cd081 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:46.878686 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-75f2c921-caaf-45fc-bb4d-1bde4d8cd081 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:47.052825 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-75f2c921-caaf-45fc-bb4d-1bde4d8cd081 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:47.061290 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-75f2c921-caaf-45fc-bb4d-1bde4d8cd081 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1500 microversion: 2.1 time: 0.197736 Nov 23 09:00:47.061925 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 174/361] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:46 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1500 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:47.086563 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-30006ed8-57bb-4726-9bdf-8601ab183405 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1190cf5-3a6e-4853-98ab-294f9fa33d9e"}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:47.087846 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-30006ed8-57bb-4726-9bdf-8601ab183405 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:47.094760 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-30006ed8-57bb-4726-9bdf-8601ab183405 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:47.095212 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-30006ed8-57bb-4726-9bdf-8601ab183405 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:47.095995 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-30006ed8-57bb-4726-9bdf-8601ab183405 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:47.096426 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-30006ed8-57bb-4726-9bdf-8601ab183405 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:47.121053 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-30006ed8-57bb-4726-9bdf-8601ab183405 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] HTTP exception thrown: Cannot 'attach_volume' instance 4e7614ff-90ad-4ed2-9d48-3b0585258f88 while it is in vm_state rescued Nov 23 09:00:47.121666 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-30006ed8-57bb-4726-9bdf-8601ab183405 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Returning 409 to user: Cannot 'attach_volume' instance 4e7614ff-90ad-4ed2-9d48-3b0585258f88 while it is in vm_state rescued {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 09:00:47.122523 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-30006ed8-57bb-4726-9bdf-8601ab183405 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "POST /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040604 Nov 23 09:00:47.123057 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 188/362] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 23 09:00:47 2021] POST /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 23 09:00:47.132151 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-b4a80ca7-0aa2-41f5-b34b-848fdfb7cb41 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:47.132607 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-b4a80ca7-0aa2-41f5-b34b-848fdfb7cb41 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:47.138799 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b4a80ca7-0aa2-41f5-b34b-848fdfb7cb41 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:47.139248 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b4a80ca7-0aa2-41f5-b34b-848fdfb7cb41 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:47.140038 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b4a80ca7-0aa2-41f5-b34b-848fdfb7cb41 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:47.140476 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b4a80ca7-0aa2-41f5-b34b-848fdfb7cb41 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:47.205308 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-b4a80ca7-0aa2-41f5-b34b-848fdfb7cb41 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "POST /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88/action" status: 202 len: 0 microversion: 2.1 time: 0.076783 Nov 23 09:00:47.205994 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 175/363] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:00:47 2021] POST /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:00:47.214396 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-2d39a53c-c8c7-458a-b52f-091b02ac5ee8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:47.215224 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-2d39a53c-c8c7-458a-b52f-091b02ac5ee8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:47.231069 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2d39a53c-c8c7-458a-b52f-091b02ac5ee8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:47.232502 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2d39a53c-c8c7-458a-b52f-091b02ac5ee8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:47.233652 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2d39a53c-c8c7-458a-b52f-091b02ac5ee8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:47.236116 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2d39a53c-c8c7-458a-b52f-091b02ac5ee8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:47.316613 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-111e6fd6-0cca-43e1-8bd4-06f91062f054 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:47.318882 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-111e6fd6-0cca-43e1-8bd4-06f91062f054 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:47.326887 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-111e6fd6-0cca-43e1-8bd4-06f91062f054 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:47.327486 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-111e6fd6-0cca-43e1-8bd4-06f91062f054 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:47.328391 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-111e6fd6-0cca-43e1-8bd4-06f91062f054 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:47.328925 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-111e6fd6-0cca-43e1-8bd4-06f91062f054 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:47.427749 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-111e6fd6-0cca-43e1-8bd4-06f91062f054 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 200 len: 38193 microversion: 2.20 time: 0.115757 Nov 23 09:00:47.428532 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 176/364] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:00:47 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 38193 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:00:47.439239 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-a72110f6-002f-4913-941a-8ac2e843f579 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:47.439974 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-a72110f6-002f-4913-941a-8ac2e843f579 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:47.446819 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a72110f6-002f-4913-941a-8ac2e843f579 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:47.447266 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a72110f6-002f-4913-941a-8ac2e843f579 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:47.448070 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a72110f6-002f-4913-941a-8ac2e843f579 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:47.448498 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a72110f6-002f-4913-941a-8ac2e843f579 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:47.473232 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-a72110f6-002f-4913-941a-8ac2e843f579 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/ips" status: 200 len: 152 microversion: 2.20 time: 0.038497 Nov 23 09:00:47.473853 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 177/365] 10.222.0.46 () {60 vars in 1288 bytes} [Tue Nov 23 09:00:47 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 09:00:47.479900 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-2d39a53c-c8c7-458a-b52f-091b02ac5ee8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:47.488288 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-2d39a53c-c8c7-458a-b52f-091b02ac5ee8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1508 microversion: 2.1 time: 0.277713 Nov 23 09:00:47.489198 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 189/366] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:47 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1508 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:00:47.762944 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-a4202bfa-2bc7-40c1-8ce7-2f175968d73d tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:47.763922 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-a4202bfa-2bc7-40c1-8ce7-2f175968d73d tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 468f160d-19b7-4d4c-a51a-a74c32cc4d75] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:47.770527 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a4202bfa-2bc7-40c1-8ce7-2f175968d73d tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:47.771080 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a4202bfa-2bc7-40c1-8ce7-2f175968d73d tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:47.771883 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a4202bfa-2bc7-40c1-8ce7-2f175968d73d tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:47.772326 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a4202bfa-2bc7-40c1-8ce7-2f175968d73d tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:47.911730 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-a4202bfa-2bc7-40c1-8ce7-2f175968d73d tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:47.919875 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-a4202bfa-2bc7-40c1-8ce7-2f175968d73d tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75" status: 200 len: 1317 microversion: 2.1 time: 0.161065 Nov 23 09:00:47.920446 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 178/367] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:47 2021] GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:48.506453 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e7788ac2-7847-432e-b6c6-84fcfb544434 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:48.507220 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e7788ac2-7847-432e-b6c6-84fcfb544434 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:48.513970 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e7788ac2-7847-432e-b6c6-84fcfb544434 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:48.514423 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e7788ac2-7847-432e-b6c6-84fcfb544434 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:48.515245 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e7788ac2-7847-432e-b6c6-84fcfb544434 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:48.515692 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e7788ac2-7847-432e-b6c6-84fcfb544434 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:48.706975 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-e7788ac2-7847-432e-b6c6-84fcfb544434 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:48.714323 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e7788ac2-7847-432e-b6c6-84fcfb544434 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1508 microversion: 2.1 time: 0.211742 Nov 23 09:00:48.714907 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 190/368] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:48 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1508 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:48.935668 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-df48d883-12f5-4c78-b5d8-16bb8fef2236 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:48.936309 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-df48d883-12f5-4c78-b5d8-16bb8fef2236 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 468f160d-19b7-4d4c-a51a-a74c32cc4d75] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:48.947671 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-df48d883-12f5-4c78-b5d8-16bb8fef2236 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:48.948336 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-df48d883-12f5-4c78-b5d8-16bb8fef2236 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:48.948905 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-df48d883-12f5-4c78-b5d8-16bb8fef2236 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:48.949364 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-df48d883-12f5-4c78-b5d8-16bb8fef2236 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:49.085993 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-df48d883-12f5-4c78-b5d8-16bb8fef2236 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:49.097599 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-df48d883-12f5-4c78-b5d8-16bb8fef2236 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75" status: 200 len: 1317 microversion: 2.1 time: 0.162376 Nov 23 09:00:49.097599 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 179/369] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:48 2021] GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:49.480415 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-67a55681-62c7-487a-859a-284f8bdf92fa tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:49.480900 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-67a55681-62c7-487a-859a-284f8bdf92fa tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: 1b386ea7-77b5-48b4-a375-10966f3dd299] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:49.487503 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-67a55681-62c7-487a-859a-284f8bdf92fa tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:49.487963 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-67a55681-62c7-487a-859a-284f8bdf92fa tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:49.488766 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-67a55681-62c7-487a-859a-284f8bdf92fa tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:49.489228 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-67a55681-62c7-487a-859a-284f8bdf92fa tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:49.569101 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.objects.instance [None req-67a55681-62c7-487a-859a-284f8bdf92fa tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lazy-loading 'services' on Instance uuid 1b386ea7-77b5-48b4-a375-10966f3dd299 {{(pid=116226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 09:00:49.641938 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-67a55681-62c7-487a-859a-284f8bdf92fa tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299/os-volume_attachments/73303790-f158-4352-9f49-bf9433affbe6" status: 202 len: 0 microversion: 2.1 time: 0.167433 Nov 23 09:00:49.642534 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 191/370] 10.222.0.46 () {58 vars in 1415 bytes} [Tue Nov 23 09:00:49 2021] DELETE /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299/os-volume_attachments/73303790-f158-4352-9f49-bf9433affbe6 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 09:00:49.732976 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-cde2146d-6007-4977-a8b1-45e3fb85df93 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:49.733905 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-cde2146d-6007-4977-a8b1-45e3fb85df93 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:49.740470 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-cde2146d-6007-4977-a8b1-45e3fb85df93 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:49.741052 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-cde2146d-6007-4977-a8b1-45e3fb85df93 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:49.742032 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-cde2146d-6007-4977-a8b1-45e3fb85df93 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:49.742522 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-cde2146d-6007-4977-a8b1-45e3fb85df93 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:49.902892 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-cde2146d-6007-4977-a8b1-45e3fb85df93 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:49.910933 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-cde2146d-6007-4977-a8b1-45e3fb85df93 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1508 microversion: 2.1 time: 0.182430 Nov 23 09:00:49.911692 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 180/371] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:49 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1508 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:50.112251 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-91b348fb-a7d4-4e30-9e6a-a91853964c35 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:50.112940 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-91b348fb-a7d4-4e30-9e6a-a91853964c35 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 468f160d-19b7-4d4c-a51a-a74c32cc4d75] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:50.124515 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-91b348fb-a7d4-4e30-9e6a-a91853964c35 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:50.124966 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-91b348fb-a7d4-4e30-9e6a-a91853964c35 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:50.125782 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-91b348fb-a7d4-4e30-9e6a-a91853964c35 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:50.126220 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-91b348fb-a7d4-4e30-9e6a-a91853964c35 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:50.261593 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-91b348fb-a7d4-4e30-9e6a-a91853964c35 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:50.269005 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-91b348fb-a7d4-4e30-9e6a-a91853964c35 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75" status: 200 len: 1317 microversion: 2.1 time: 0.160703 Nov 23 09:00:50.269625 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 192/372] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:50 2021] GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:50.928149 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-94a47513-26c6-4414-933c-55edc5d60673 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:50.928787 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-94a47513-26c6-4414-933c-55edc5d60673 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:50.935482 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-94a47513-26c6-4414-933c-55edc5d60673 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:50.935954 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-94a47513-26c6-4414-933c-55edc5d60673 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:50.936747 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-94a47513-26c6-4414-933c-55edc5d60673 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:50.937244 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-94a47513-26c6-4414-933c-55edc5d60673 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:51.074362 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-94a47513-26c6-4414-933c-55edc5d60673 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:51.082567 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-94a47513-26c6-4414-933c-55edc5d60673 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1508 microversion: 2.1 time: 0.158100 Nov 23 09:00:51.083140 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 181/373] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:50 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:51.285091 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-3842644a-9124-4972-a8f4-ef9aebd5bff2 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:51.285727 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-3842644a-9124-4972-a8f4-ef9aebd5bff2 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 468f160d-19b7-4d4c-a51a-a74c32cc4d75] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:51.294125 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3842644a-9124-4972-a8f4-ef9aebd5bff2 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:51.294668 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3842644a-9124-4972-a8f4-ef9aebd5bff2 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:51.295458 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3842644a-9124-4972-a8f4-ef9aebd5bff2 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:51.295902 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3842644a-9124-4972-a8f4-ef9aebd5bff2 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:51.437893 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-3842644a-9124-4972-a8f4-ef9aebd5bff2 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:51.445872 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-3842644a-9124-4972-a8f4-ef9aebd5bff2 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75" status: 200 len: 1317 microversion: 2.1 time: 0.164374 Nov 23 09:00:51.451745 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 193/374] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:51 2021] GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:52.031562 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-1a1f1ab8-8512-4b93-8e4c-37bc5418be7a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:52.032091 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-1a1f1ab8-8512-4b93-8e4c-37bc5418be7a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:52.038297 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1a1f1ab8-8512-4b93-8e4c-37bc5418be7a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:52.038775 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1a1f1ab8-8512-4b93-8e4c-37bc5418be7a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:52.039567 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1a1f1ab8-8512-4b93-8e4c-37bc5418be7a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:52.040011 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1a1f1ab8-8512-4b93-8e4c-37bc5418be7a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:52.065524 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.objects.instance [None req-1a1f1ab8-8512-4b93-8e4c-37bc5418be7a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lazy-loading 'flavor' on Instance uuid 82569d71-833c-454b-a668-12dc9a37e7e2 {{(pid=116227) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 09:00:52.100674 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-4533fdfc-ab47-41bd-8fa9-bc419d003b56 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:52.101463 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-4533fdfc-ab47-41bd-8fa9-bc419d003b56 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:52.111012 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4533fdfc-ab47-41bd-8fa9-bc419d003b56 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:52.111464 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4533fdfc-ab47-41bd-8fa9-bc419d003b56 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:52.112244 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4533fdfc-ab47-41bd-8fa9-bc419d003b56 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:52.112676 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4533fdfc-ab47-41bd-8fa9-bc419d003b56 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:52.251388 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-4533fdfc-ab47-41bd-8fa9-bc419d003b56 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:52.259303 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-4533fdfc-ab47-41bd-8fa9-bc419d003b56 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1508 microversion: 2.1 time: 0.162323 Nov 23 09:00:52.259982 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 194/375] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:52 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:52.355519 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-1a1f1ab8-8512-4b93-8e4c-37bc5418be7a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 202 len: 0 microversion: 2.20 time: 0.327465 Nov 23 09:00:52.357531 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 182/376] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:00:52 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 23 09:00:52.365652 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f3892fc1-aa37-4735-8fa9-a740f9c36a61 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:52.366613 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f3892fc1-aa37-4735-8fa9-a740f9c36a61 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:52.390838 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f3892fc1-aa37-4735-8fa9-a740f9c36a61 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:52.390838 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f3892fc1-aa37-4735-8fa9-a740f9c36a61 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:52.392055 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f3892fc1-aa37-4735-8fa9-a740f9c36a61 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:52.392737 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f3892fc1-aa37-4735-8fa9-a740f9c36a61 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:52.463556 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-e4d22d62-f9fe-4101-b640-cea552b092a7 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:52.464347 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-e4d22d62-f9fe-4101-b640-cea552b092a7 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 468f160d-19b7-4d4c-a51a-a74c32cc4d75] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:52.472757 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e4d22d62-f9fe-4101-b640-cea552b092a7 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:52.473305 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e4d22d62-f9fe-4101-b640-cea552b092a7 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:52.474098 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e4d22d62-f9fe-4101-b640-cea552b092a7 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:52.474700 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e4d22d62-f9fe-4101-b640-cea552b092a7 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:52.541861 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-f3892fc1-aa37-4735-8fa9-a740f9c36a61 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:52.550216 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-f3892fc1-aa37-4735-8fa9-a740f9c36a61 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:52.551731 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-f3892fc1-aa37-4735-8fa9-a740f9c36a61 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:52.552915 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f3892fc1-aa37-4735-8fa9-a740f9c36a61 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1724 microversion: 2.20 time: 0.191005 Nov 23 09:00:52.553502 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 195/377] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:00:52 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:00:52.621124 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-e4d22d62-f9fe-4101-b640-cea552b092a7 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:52.628329 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-e4d22d62-f9fe-4101-b640-cea552b092a7 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75" status: 200 len: 1317 microversion: 2.1 time: 0.169043 Nov 23 09:00:52.628894 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 183/378] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:52 2021] GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:53.279594 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-40fb5e0e-6a43-4bc8-93a4-46f99c302439 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:53.280198 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-40fb5e0e-6a43-4bc8-93a4-46f99c302439 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:53.286041 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-40fb5e0e-6a43-4bc8-93a4-46f99c302439 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:53.286491 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-40fb5e0e-6a43-4bc8-93a4-46f99c302439 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:53.287262 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-40fb5e0e-6a43-4bc8-93a4-46f99c302439 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:53.287698 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-40fb5e0e-6a43-4bc8-93a4-46f99c302439 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:53.419765 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-40fb5e0e-6a43-4bc8-93a4-46f99c302439 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:53.426986 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-40fb5e0e-6a43-4bc8-93a4-46f99c302439 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1514 microversion: 2.1 time: 0.151065 Nov 23 09:00:53.427549 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 196/379] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:53 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:53.571575 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-28c47441-515d-4788-8ca8-30bd82a002aa tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:53.572990 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-28c47441-515d-4788-8ca8-30bd82a002aa tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:53.580236 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-28c47441-515d-4788-8ca8-30bd82a002aa tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:53.580684 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-28c47441-515d-4788-8ca8-30bd82a002aa tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:53.581536 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-28c47441-515d-4788-8ca8-30bd82a002aa tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:53.582706 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-28c47441-515d-4788-8ca8-30bd82a002aa tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:53.645436 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-6b4e5cac-b1d0-4433-8f5d-f8ed9ea62e34 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:53.646147 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-6b4e5cac-b1d0-4433-8f5d-f8ed9ea62e34 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 468f160d-19b7-4d4c-a51a-a74c32cc4d75] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:53.654229 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6b4e5cac-b1d0-4433-8f5d-f8ed9ea62e34 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:53.655628 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6b4e5cac-b1d0-4433-8f5d-f8ed9ea62e34 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:53.657073 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6b4e5cac-b1d0-4433-8f5d-f8ed9ea62e34 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:53.658120 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6b4e5cac-b1d0-4433-8f5d-f8ed9ea62e34 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:53.761932 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-28c47441-515d-4788-8ca8-30bd82a002aa tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:53.782657 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-28c47441-515d-4788-8ca8-30bd82a002aa tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:53.784318 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-28c47441-515d-4788-8ca8-30bd82a002aa tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:53.785688 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-28c47441-515d-4788-8ca8-30bd82a002aa tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1724 microversion: 2.20 time: 0.217798 Nov 23 09:00:53.786943 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 184/380] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:00:53 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:00:53.816399 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-6b4e5cac-b1d0-4433-8f5d-f8ed9ea62e34 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:53.825689 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-6b4e5cac-b1d0-4433-8f5d-f8ed9ea62e34 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75" status: 200 len: 1317 microversion: 2.1 time: 0.184186 Nov 23 09:00:53.826174 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 197/381] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:53 2021] GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75 => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:00:53.914524 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-0ee26ec9-5499-457e-b57d-f915f74e59e2 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:53.915199 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-0ee26ec9-5499-457e-b57d-f915f74e59e2 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: 1b386ea7-77b5-48b4-a375-10966f3dd299] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:53.921765 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0ee26ec9-5499-457e-b57d-f915f74e59e2 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:53.922291 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0ee26ec9-5499-457e-b57d-f915f74e59e2 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:53.923231 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0ee26ec9-5499-457e-b57d-f915f74e59e2 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:53.923673 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0ee26ec9-5499-457e-b57d-f915f74e59e2 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:53.948245 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-0ee26ec9-5499-457e-b57d-f915f74e59e2 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: 1b386ea7-77b5-48b4-a375-10966f3dd299] Going to try to terminate instance {{(pid=116227) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 09:00:54.029913 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-0ee26ec9-5499-457e-b57d-f915f74e59e2 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299" status: 204 len: 0 microversion: 2.1 time: 0.118839 Nov 23 09:00:54.030427 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 185/382] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 23 09:00:53 2021] DELETE /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 09:00:54.038764 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d7637de7-8c1a-4434-8232-05b2e291d187 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:54.040157 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d7637de7-8c1a-4434-8232-05b2e291d187 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: 1b386ea7-77b5-48b4-a375-10966f3dd299] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:54.047304 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d7637de7-8c1a-4434-8232-05b2e291d187 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:54.047762 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d7637de7-8c1a-4434-8232-05b2e291d187 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:54.048550 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d7637de7-8c1a-4434-8232-05b2e291d187 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:54.049009 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d7637de7-8c1a-4434-8232-05b2e291d187 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:54.186244 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d7637de7-8c1a-4434-8232-05b2e291d187 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:54.193748 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d7637de7-8c1a-4434-8232-05b2e291d187 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299" status: 200 len: 1513 microversion: 2.1 time: 0.159185 Nov 23 09:00:54.194317 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 198/383] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:54 2021] GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:54.807391 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-c9851c28-6ece-4163-8e01-7b9bfedff4a2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:54.808777 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-c9851c28-6ece-4163-8e01-7b9bfedff4a2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:54.817760 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c9851c28-6ece-4163-8e01-7b9bfedff4a2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:54.818401 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c9851c28-6ece-4163-8e01-7b9bfedff4a2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:54.819408 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c9851c28-6ece-4163-8e01-7b9bfedff4a2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:54.819994 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c9851c28-6ece-4163-8e01-7b9bfedff4a2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:54.829504 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-22194bc6-3d64-4efc-850b-3f9d45613c1c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:54.830062 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-22194bc6-3d64-4efc-850b-3f9d45613c1c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:54.845625 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-22194bc6-3d64-4efc-850b-3f9d45613c1c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:54.846322 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-22194bc6-3d64-4efc-850b-3f9d45613c1c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:54.848135 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-22194bc6-3d64-4efc-850b-3f9d45613c1c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:54.851558 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-22194bc6-3d64-4efc-850b-3f9d45613c1c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:55.008416 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-22194bc6-3d64-4efc-850b-3f9d45613c1c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:55.016938 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-c9851c28-6ece-4163-8e01-7b9bfedff4a2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:55.022628 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-22194bc6-3d64-4efc-850b-3f9d45613c1c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1514 microversion: 2.1 time: 0.196814 Nov 23 09:00:55.023534 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 199/384] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:54 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1514 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:00:55.029576 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-c9851c28-6ece-4163-8e01-7b9bfedff4a2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:55.031286 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-c9851c28-6ece-4163-8e01-7b9bfedff4a2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:55.032460 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-c9851c28-6ece-4163-8e01-7b9bfedff4a2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1724 microversion: 2.20 time: 0.231210 Nov 23 09:00:55.037616 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-369417ef-a113-4876-b222-4b8ca79092a8 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:55.038139 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-369417ef-a113-4876-b222-4b8ca79092a8 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 468f160d-19b7-4d4c-a51a-a74c32cc4d75] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:55.039254 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 186/385] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:00:54 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:00:55.048419 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-369417ef-a113-4876-b222-4b8ca79092a8 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:55.048771 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-6e0771f5-b1ba-4152-9f2c-91f627826bfe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa3b8c05-dd41-4bbb-9a09-7bd29536904a"}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:55.049088 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-369417ef-a113-4876-b222-4b8ca79092a8 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:55.050061 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-369417ef-a113-4876-b222-4b8ca79092a8 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:55.050487 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-6e0771f5-b1ba-4152-9f2c-91f627826bfe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:55.050605 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-369417ef-a113-4876-b222-4b8ca79092a8 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:55.057944 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6e0771f5-b1ba-4152-9f2c-91f627826bfe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:55.058573 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6e0771f5-b1ba-4152-9f2c-91f627826bfe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:55.059436 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6e0771f5-b1ba-4152-9f2c-91f627826bfe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:55.059885 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6e0771f5-b1ba-4152-9f2c-91f627826bfe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:55.211599 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-369417ef-a113-4876-b222-4b8ca79092a8 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:55.220485 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-369417ef-a113-4876-b222-4b8ca79092a8 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75" status: 200 len: 1317 microversion: 2.1 time: 0.186453 Nov 23 09:00:55.221051 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 200/386] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:55 2021] GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75 => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:55.232338 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-98256038-111d-447c-81e7-b0abe0718d35 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:55.232940 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-98256038-111d-447c-81e7-b0abe0718d35 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: 1b386ea7-77b5-48b4-a375-10966f3dd299] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:55.241312 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-98256038-111d-447c-81e7-b0abe0718d35 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:55.241799 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-98256038-111d-447c-81e7-b0abe0718d35 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:55.242534 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-98256038-111d-447c-81e7-b0abe0718d35 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:55.242965 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-98256038-111d-447c-81e7-b0abe0718d35 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:55.339982 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-6e0771f5-b1ba-4152-9f2c-91f627826bfe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "POST /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297504 Nov 23 09:00:55.340791 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 187/387] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 23 09:00:55 2021] POST /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 09:00:55.354307 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-b9ae89a7-8636-4a18-b60e-5115965de1b6 req-c9c8c759-3282-435b-8152-aa2216efe9d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "468f160d-19b7-4d4c-a51a-a74c32cc4d75", "name": "network-vif-plugged", "status": "completed", "tag": "b57d2fa5-0e4c-480c-a153-ec9850be0754"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:00:55.357882 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:00:55.357882 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 09:00:55.367480 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-b9ae89a7-8636-4a18-b60e-5115965de1b6 req-c9c8c759-3282-435b-8152-aa2216efe9d2 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:55.367932 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-b9ae89a7-8636-4a18-b60e-5115965de1b6 req-c9c8c759-3282-435b-8152-aa2216efe9d2 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:55.381743 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-b9ae89a7-8636-4a18-b60e-5115965de1b6 req-c9c8c759-3282-435b-8152-aa2216efe9d2 service nova] Creating event network-vif-plugged:b57d2fa5-0e4c-480c-a153-ec9850be0754 for instance 468f160d-19b7-4d4c-a51a-a74c32cc4d75 on hv-cinder-76845 Nov 23 09:00:55.386386 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-b9ae89a7-8636-4a18-b60e-5115965de1b6 req-c9c8c759-3282-435b-8152-aa2216efe9d2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037948 Nov 23 09:00:55.387979 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 188/388] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:00:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:00:55.402501 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-98256038-111d-447c-81e7-b0abe0718d35 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:55.410926 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-98256038-111d-447c-81e7-b0abe0718d35 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299" status: 200 len: 1513 microversion: 2.1 time: 0.182573 Nov 23 09:00:55.411645 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 201/389] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:55 2021] GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299 => generated 1513 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:56.051602 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-4055d438-877b-4e55-a784-2515415c0380 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:56.052294 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-4055d438-877b-4e55-a784-2515415c0380 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:56.058429 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4055d438-877b-4e55-a784-2515415c0380 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:56.059021 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4055d438-877b-4e55-a784-2515415c0380 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:56.060598 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4055d438-877b-4e55-a784-2515415c0380 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:56.061041 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4055d438-877b-4e55-a784-2515415c0380 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:56.228943 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-4055d438-877b-4e55-a784-2515415c0380 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:56.238523 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-4055d438-877b-4e55-a784-2515415c0380 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:56.239337 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-048ac08e-9bb2-4bcd-938c-0be25c8f8817 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:56.240018 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-048ac08e-9bb2-4bcd-938c-0be25c8f8817 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 468f160d-19b7-4d4c-a51a-a74c32cc4d75] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:56.250450 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-048ac08e-9bb2-4bcd-938c-0be25c8f8817 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:56.250450 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-048ac08e-9bb2-4bcd-938c-0be25c8f8817 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:56.250450 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-048ac08e-9bb2-4bcd-938c-0be25c8f8817 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:56.250450 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-048ac08e-9bb2-4bcd-938c-0be25c8f8817 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:56.251280 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-4055d438-877b-4e55-a784-2515415c0380 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:56.252860 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-4055d438-877b-4e55-a784-2515415c0380 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1724 microversion: 2.20 time: 0.205694 Nov 23 09:00:56.264865 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 189/390] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:00:56 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:00:56.391135 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-048ac08e-9bb2-4bcd-938c-0be25c8f8817 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:56.399573 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-048ac08e-9bb2-4bcd-938c-0be25c8f8817 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75" status: 200 len: 1317 microversion: 2.1 time: 0.164608 Nov 23 09:00:56.409443 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 202/391] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:56 2021] GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:56.429440 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-c081a107-01e6-41e2-8bfb-b085b833da30 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:56.430492 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-c081a107-01e6-41e2-8bfb-b085b833da30 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: 1b386ea7-77b5-48b4-a375-10966f3dd299] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:56.443468 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c081a107-01e6-41e2-8bfb-b085b833da30 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:56.444239 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c081a107-01e6-41e2-8bfb-b085b833da30 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:56.446270 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c081a107-01e6-41e2-8bfb-b085b833da30 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:56.447086 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c081a107-01e6-41e2-8bfb-b085b833da30 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:56.586305 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-c081a107-01e6-41e2-8bfb-b085b833da30 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:56.594660 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-c081a107-01e6-41e2-8bfb-b085b833da30 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299" status: 200 len: 1513 microversion: 2.1 time: 0.169178 Nov 23 09:00:56.595260 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 190/392] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:56 2021] GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299 => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:57.270411 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f3da2974-7995-463a-b538-659086d621f2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:57.271152 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f3da2974-7995-463a-b538-659086d621f2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:57.277320 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f3da2974-7995-463a-b538-659086d621f2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:57.278377 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f3da2974-7995-463a-b538-659086d621f2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:57.279165 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f3da2974-7995-463a-b538-659086d621f2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:57.279601 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f3da2974-7995-463a-b538-659086d621f2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:57.409848 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-f3da2974-7995-463a-b538-659086d621f2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:57.415757 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-6243cb80-2ed5-46ad-a8b5-797f396e4f79 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:57.416473 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-6243cb80-2ed5-46ad-a8b5-797f396e4f79 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 468f160d-19b7-4d4c-a51a-a74c32cc4d75] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:57.419995 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-f3da2974-7995-463a-b538-659086d621f2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:57.421516 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-f3da2974-7995-463a-b538-659086d621f2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:57.422682 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f3da2974-7995-463a-b538-659086d621f2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1724 microversion: 2.20 time: 0.155950 Nov 23 09:00:57.423433 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 203/393] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:00:57 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:00:57.426027 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6243cb80-2ed5-46ad-a8b5-797f396e4f79 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:57.426488 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6243cb80-2ed5-46ad-a8b5-797f396e4f79 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:57.427287 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6243cb80-2ed5-46ad-a8b5-797f396e4f79 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:57.427730 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6243cb80-2ed5-46ad-a8b5-797f396e4f79 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:57.568345 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-6243cb80-2ed5-46ad-a8b5-797f396e4f79 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:57.577176 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-6243cb80-2ed5-46ad-a8b5-797f396e4f79 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75" status: 200 len: 1317 microversion: 2.1 time: 0.165185 Nov 23 09:00:57.577831 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 191/394] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:57 2021] GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:00:57.612470 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-3cdb1b04-47fa-4c9a-bcb5-87f6f6cc7387 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:57.613085 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-3cdb1b04-47fa-4c9a-bcb5-87f6f6cc7387 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: 1b386ea7-77b5-48b4-a375-10966f3dd299] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:57.618878 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3cdb1b04-47fa-4c9a-bcb5-87f6f6cc7387 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:57.619330 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3cdb1b04-47fa-4c9a-bcb5-87f6f6cc7387 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:57.620109 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3cdb1b04-47fa-4c9a-bcb5-87f6f6cc7387 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:57.620543 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3cdb1b04-47fa-4c9a-bcb5-87f6f6cc7387 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:57.753477 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-3cdb1b04-47fa-4c9a-bcb5-87f6f6cc7387 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:57.760758 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-3cdb1b04-47fa-4c9a-bcb5-87f6f6cc7387 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299" status: 200 len: 1513 microversion: 2.1 time: 0.152074 Nov 23 09:00:57.761417 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 204/395] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:57 2021] GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:58.440719 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-9b98d613-b408-499a-9587-0eb9e272eef0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:58.441356 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-9b98d613-b408-499a-9587-0eb9e272eef0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:58.447612 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9b98d613-b408-499a-9587-0eb9e272eef0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:58.448001 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9b98d613-b408-499a-9587-0eb9e272eef0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:58.448803 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9b98d613-b408-499a-9587-0eb9e272eef0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:58.449260 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9b98d613-b408-499a-9587-0eb9e272eef0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:58.582230 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-9b98d613-b408-499a-9587-0eb9e272eef0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:58.589827 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-9b98d613-b408-499a-9587-0eb9e272eef0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:58.592333 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-9b98d613-b408-499a-9587-0eb9e272eef0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:58.593910 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-9b98d613-b408-499a-9587-0eb9e272eef0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1724 microversion: 2.20 time: 0.156624 Nov 23 09:00:58.602317 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-db0b6b33-9e9b-49c8-9c29-f7543a67115d tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:58.603026 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-db0b6b33-9e9b-49c8-9c29-f7543a67115d tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 468f160d-19b7-4d4c-a51a-a74c32cc4d75] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:58.603153 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 192/396] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:00:58 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:00:58.610282 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-db0b6b33-9e9b-49c8-9c29-f7543a67115d tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:58.610740 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-db0b6b33-9e9b-49c8-9c29-f7543a67115d tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:58.611723 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-db0b6b33-9e9b-49c8-9c29-f7543a67115d tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:58.612166 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-db0b6b33-9e9b-49c8-9c29-f7543a67115d tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:58.741209 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-db0b6b33-9e9b-49c8-9c29-f7543a67115d tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:58.748575 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-db0b6b33-9e9b-49c8-9c29-f7543a67115d tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75" status: 200 len: 1317 microversion: 2.1 time: 0.158067 Nov 23 09:00:58.749246 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 205/397] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:58 2021] GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:00:58.778710 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-e1920226-4066-403f-972a-395337da65c5 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:58.779305 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-e1920226-4066-403f-972a-395337da65c5 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: 1b386ea7-77b5-48b4-a375-10966f3dd299] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:58.785187 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e1920226-4066-403f-972a-395337da65c5 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:58.785646 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e1920226-4066-403f-972a-395337da65c5 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:58.786420 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e1920226-4066-403f-972a-395337da65c5 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:58.786850 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e1920226-4066-403f-972a-395337da65c5 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:58.924685 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-e1920226-4066-403f-972a-395337da65c5 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:58.932018 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-e1920226-4066-403f-972a-395337da65c5 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299" status: 200 len: 1513 microversion: 2.1 time: 0.157463 Nov 23 09:00:58.933233 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 193/398] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:58 2021] GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:00:59.612625 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-38f64dd9-612b-4a43-8059-11c4a983f4fb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:59.613269 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-38f64dd9-612b-4a43-8059-11c4a983f4fb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:59.619426 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-38f64dd9-612b-4a43-8059-11c4a983f4fb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:59.619876 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-38f64dd9-612b-4a43-8059-11c4a983f4fb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:59.620842 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-38f64dd9-612b-4a43-8059-11c4a983f4fb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:59.621309 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-38f64dd9-612b-4a43-8059-11c4a983f4fb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:59.750327 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-38f64dd9-612b-4a43-8059-11c4a983f4fb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:59.757882 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-38f64dd9-612b-4a43-8059-11c4a983f4fb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:59.759400 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-38f64dd9-612b-4a43-8059-11c4a983f4fb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:59.760535 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-38f64dd9-612b-4a43-8059-11c4a983f4fb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1724 microversion: 2.20 time: 0.151592 Nov 23 09:00:59.761114 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 206/399] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:00:59 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:00:59.765333 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-848acdb3-076a-4548-a5ae-f88959e81eae tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:59.765947 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-848acdb3-076a-4548-a5ae-f88959e81eae tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 468f160d-19b7-4d4c-a51a-a74c32cc4d75] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:59.772122 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-848acdb3-076a-4548-a5ae-f88959e81eae tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:59.772627 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-848acdb3-076a-4548-a5ae-f88959e81eae tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:59.773377 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-848acdb3-076a-4548-a5ae-f88959e81eae tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:59.773817 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-848acdb3-076a-4548-a5ae-f88959e81eae tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:59.904776 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-848acdb3-076a-4548-a5ae-f88959e81eae tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:00:59.911868 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-848acdb3-076a-4548-a5ae-f88959e81eae tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75" status: 200 len: 1317 microversion: 2.1 time: 0.150287 Nov 23 09:00:59.912440 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 194/400] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:59 2021] GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:00:59.949250 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-5ab29f6a-f56d-4b88-86da-3be12ff51dca tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:00:59.950417 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-5ab29f6a-f56d-4b88-86da-3be12ff51dca tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: 1b386ea7-77b5-48b4-a375-10966f3dd299] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:00:59.956208 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5ab29f6a-f56d-4b88-86da-3be12ff51dca tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:59.956665 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5ab29f6a-f56d-4b88-86da-3be12ff51dca tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:00:59.957472 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5ab29f6a-f56d-4b88-86da-3be12ff51dca tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:00:59.957917 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5ab29f6a-f56d-4b88-86da-3be12ff51dca tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:00.216968 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-5ab29f6a-f56d-4b88-86da-3be12ff51dca tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:00.224588 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-5ab29f6a-f56d-4b88-86da-3be12ff51dca tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299" status: 200 len: 1513 microversion: 2.1 time: 0.279084 Nov 23 09:01:00.225178 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 207/401] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:00:59 2021] GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299 => generated 1513 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:00.778706 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-de307c8f-1ee8-4a28-a14b-148062b3a2fc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:00.779892 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-de307c8f-1ee8-4a28-a14b-148062b3a2fc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:00.786217 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-de307c8f-1ee8-4a28-a14b-148062b3a2fc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:00.786678 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-de307c8f-1ee8-4a28-a14b-148062b3a2fc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:00.787473 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-de307c8f-1ee8-4a28-a14b-148062b3a2fc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:00.788140 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-de307c8f-1ee8-4a28-a14b-148062b3a2fc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:00.810976 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-4b0949aa-9ae3-45e9-a0aa-29901149188f req-14d248c1-9486-438e-ad6b-163fdea1080f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b386ea7-77b5-48b4-a375-10966f3dd299", "name": "network-vif-deleted", "tag": "f11c5832-1be3-47ce-9fbb-7c5c32b35c5b"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:01:00.812897 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:01:00.812897 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 09:01:00.821980 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-4b0949aa-9ae3-45e9-a0aa-29901149188f req-14d248c1-9486-438e-ad6b-163fdea1080f service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:00.822435 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-4b0949aa-9ae3-45e9-a0aa-29901149188f req-14d248c1-9486-438e-ad6b-163fdea1080f service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:00.837356 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-4b0949aa-9ae3-45e9-a0aa-29901149188f req-14d248c1-9486-438e-ad6b-163fdea1080f service nova] Creating event network-vif-deleted:f11c5832-1be3-47ce-9fbb-7c5c32b35c5b for instance 1b386ea7-77b5-48b4-a375-10966f3dd299 on hv-cinder-76845 Nov 23 09:01:00.845949 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-4b0949aa-9ae3-45e9-a0aa-29901149188f req-14d248c1-9486-438e-ad6b-163fdea1080f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040408 Nov 23 09:01:00.847267 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 208/402] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:01:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Nov 23 09:01:00.930055 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-9c29e4c6-d020-43fb-92a5-18b5288aa55a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:00.931001 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-9c29e4c6-d020-43fb-92a5-18b5288aa55a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 468f160d-19b7-4d4c-a51a-a74c32cc4d75] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:00.938015 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9c29e4c6-d020-43fb-92a5-18b5288aa55a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:00.939586 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9c29e4c6-d020-43fb-92a5-18b5288aa55a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:00.940565 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9c29e4c6-d020-43fb-92a5-18b5288aa55a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:00.941009 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9c29e4c6-d020-43fb-92a5-18b5288aa55a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:00.952909 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-de307c8f-1ee8-4a28-a14b-148062b3a2fc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:00.963826 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-de307c8f-1ee8-4a28-a14b-148062b3a2fc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:00.966138 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-de307c8f-1ee8-4a28-a14b-148062b3a2fc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:00.967683 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-de307c8f-1ee8-4a28-a14b-148062b3a2fc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1724 microversion: 2.20 time: 0.192792 Nov 23 09:01:00.968256 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 195/403] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:00 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 09:01:01.079180 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-9c29e4c6-d020-43fb-92a5-18b5288aa55a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:01.087530 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-9c29e4c6-d020-43fb-92a5-18b5288aa55a tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75" status: 200 len: 1506 microversion: 2.1 time: 0.162473 Nov 23 09:01:01.088186 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 209/404] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:00 2021] GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75 => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:01:01.242376 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-3f73db05-a610-43f1-b001-ca77ea15965c tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:01.242981 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-3f73db05-a610-43f1-b001-ca77ea15965c tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: 1b386ea7-77b5-48b4-a375-10966f3dd299] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:01.249427 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3f73db05-a610-43f1-b001-ca77ea15965c tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:01.249877 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3f73db05-a610-43f1-b001-ca77ea15965c tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:01.250655 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3f73db05-a610-43f1-b001-ca77ea15965c tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:01.251089 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3f73db05-a610-43f1-b001-ca77ea15965c tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:01.283594 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3f73db05-a610-43f1-b001-ca77ea15965c tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:01.283960 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3f73db05-a610-43f1-b001-ca77ea15965c tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:01.284409 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.objects.instance [None req-3f73db05-a610-43f1-b001-ca77ea15965c tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lazy-loading 'fault' on Instance uuid 1b386ea7-77b5-48b4-a375-10966f3dd299 {{(pid=116227) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 09:01:01.337580 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-3f73db05-a610-43f1-b001-ca77ea15965c tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:01.347273 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-3f73db05-a610-43f1-b001-ca77ea15965c tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299" status: 200 len: 1309 microversion: 2.1 time: 0.108503 Nov 23 09:01:01.356122 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 196/405] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:01 2021] GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299 => generated 1309 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:01.986258 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-9ccfd737-bb67-4f76-b17f-3766ba6da062 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:01.987408 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-9ccfd737-bb67-4f76-b17f-3766ba6da062 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:01.993739 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9ccfd737-bb67-4f76-b17f-3766ba6da062 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:01.994189 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9ccfd737-bb67-4f76-b17f-3766ba6da062 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:01.995071 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9ccfd737-bb67-4f76-b17f-3766ba6da062 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:01.995598 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9ccfd737-bb67-4f76-b17f-3766ba6da062 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:02.125755 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-9ccfd737-bb67-4f76-b17f-3766ba6da062 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:02.133508 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-9ccfd737-bb67-4f76-b17f-3766ba6da062 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:02.135010 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-9ccfd737-bb67-4f76-b17f-3766ba6da062 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:02.136165 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-9ccfd737-bb67-4f76-b17f-3766ba6da062 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1724 microversion: 2.20 time: 0.153541 Nov 23 09:01:02.136727 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 210/406] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:01 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:01:02.365007 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-dd55aad4-e826-4afd-a7e0-54146e409090 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:02.365652 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-dd55aad4-e826-4afd-a7e0-54146e409090 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: 1b386ea7-77b5-48b4-a375-10966f3dd299] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:02.373176 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-dd55aad4-e826-4afd-a7e0-54146e409090 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:02.374364 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-dd55aad4-e826-4afd-a7e0-54146e409090 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:02.375406 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-dd55aad4-e826-4afd-a7e0-54146e409090 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:02.375887 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-dd55aad4-e826-4afd-a7e0-54146e409090 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:02.391483 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.wsgi [None req-dd55aad4-e826-4afd-a7e0-54146e409090 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] HTTP exception thrown: Instance 1b386ea7-77b5-48b4-a375-10966f3dd299 could not be found. Nov 23 09:01:02.392122 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-dd55aad4-e826-4afd-a7e0-54146e409090 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Returning 404 to user: Instance 1b386ea7-77b5-48b4-a375-10966f3dd299 could not be found. {{(pid=116227) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 09:01:02.392966 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-dd55aad4-e826-4afd-a7e0-54146e409090 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299" status: 404 len: 111 microversion: 2.1 time: 0.031791 Nov 23 09:01:02.393540 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 197/407] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:02 2021] GET /compute/v2.1/servers/1b386ea7-77b5-48b4-a375-10966f3dd299 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 09:01:02.406164 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d8a337e0-251f-4836-a98f-0144ee1406b2 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51db3046-9005-46c8-adc7-23a8328239dc"}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:01:02.407251 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d8a337e0-251f-4836-a98f-0144ee1406b2 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 468f160d-19b7-4d4c-a51a-a74c32cc4d75] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:02.412998 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d8a337e0-251f-4836-a98f-0144ee1406b2 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:02.413486 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d8a337e0-251f-4836-a98f-0144ee1406b2 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:02.415024 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d8a337e0-251f-4836-a98f-0144ee1406b2 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:02.415024 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d8a337e0-251f-4836-a98f-0144ee1406b2 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:02.664443 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d8a337e0-251f-4836-a98f-0144ee1406b2 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "POST /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262047 Nov 23 09:01:02.665317 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 211/408] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 23 09:01:02 2021] POST /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:01:02.924287 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-761e7365-a545-4db4-81d7-f860c8bd2abe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:01:02.925322 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-761e7365-a545-4db4-81d7-f860c8bd2abe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:02.931697 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-761e7365-a545-4db4-81d7-f860c8bd2abe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:02.932152 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-761e7365-a545-4db4-81d7-f860c8bd2abe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:02.932969 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-761e7365-a545-4db4-81d7-f860c8bd2abe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:02.933522 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-761e7365-a545-4db4-81d7-f860c8bd2abe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:02.957297 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.objects.instance [None req-761e7365-a545-4db4-81d7-f860c8bd2abe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lazy-loading 'flavor' on Instance uuid 4e7614ff-90ad-4ed2-9d48-3b0585258f88 {{(pid=116227) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 09:01:03.091634 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-761e7365-a545-4db4-81d7-f860c8bd2abe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "POST /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88/action" status: 200 len: 32 microversion: 2.1 time: 0.170691 Nov 23 09:01:03.093056 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 198/409] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:01:02 2021] POST /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88/action => generated 32 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 09:01:03.107979 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-5b9c8b30-4f08-471f-a948-f51f1859fb18 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:03.109386 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-5b9c8b30-4f08-471f-a948-f51f1859fb18 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:03.118269 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5b9c8b30-4f08-471f-a948-f51f1859fb18 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:03.118826 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5b9c8b30-4f08-471f-a948-f51f1859fb18 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:03.119834 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5b9c8b30-4f08-471f-a948-f51f1859fb18 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:03.120387 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5b9c8b30-4f08-471f-a948-f51f1859fb18 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:03.156558 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-8b9a364f-2517-4590-98ed-db944e5e3d6f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:03.157302 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-8b9a364f-2517-4590-98ed-db944e5e3d6f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:03.163512 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8b9a364f-2517-4590-98ed-db944e5e3d6f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:03.164157 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8b9a364f-2517-4590-98ed-db944e5e3d6f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:03.165116 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8b9a364f-2517-4590-98ed-db944e5e3d6f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:03.165723 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8b9a364f-2517-4590-98ed-db944e5e3d6f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:03.267142 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-5b9c8b30-4f08-471f-a948-f51f1859fb18 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:03.275398 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-5b9c8b30-4f08-471f-a948-f51f1859fb18 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1566 microversion: 2.1 time: 0.176464 Nov 23 09:01:03.275982 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 212/410] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:03 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1566 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:03.364555 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-8b9a364f-2517-4590-98ed-db944e5e3d6f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:03.373514 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-8b9a364f-2517-4590-98ed-db944e5e3d6f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:03.375165 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-8b9a364f-2517-4590-98ed-db944e5e3d6f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:03.376307 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-8b9a364f-2517-4590-98ed-db944e5e3d6f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1724 microversion: 2.20 time: 0.224325 Nov 23 09:01:03.376967 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 199/411] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:03 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:01:04.292325 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-1ef35eff-8a46-498c-bf53-e93248c132f4 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:04.292932 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-1ef35eff-8a46-498c-bf53-e93248c132f4 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:04.299621 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1ef35eff-8a46-498c-bf53-e93248c132f4 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:04.300052 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1ef35eff-8a46-498c-bf53-e93248c132f4 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:04.300820 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1ef35eff-8a46-498c-bf53-e93248c132f4 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:04.301287 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1ef35eff-8a46-498c-bf53-e93248c132f4 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:04.393869 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-b0103451-f2b2-469c-a3f5-1019e070a4bb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:04.394469 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-b0103451-f2b2-469c-a3f5-1019e070a4bb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:04.400876 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b0103451-f2b2-469c-a3f5-1019e070a4bb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:04.401440 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b0103451-f2b2-469c-a3f5-1019e070a4bb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:04.402258 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b0103451-f2b2-469c-a3f5-1019e070a4bb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:04.402728 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b0103451-f2b2-469c-a3f5-1019e070a4bb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:04.433142 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-1ef35eff-8a46-498c-bf53-e93248c132f4 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:04.449122 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-1ef35eff-8a46-498c-bf53-e93248c132f4 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1566 microversion: 2.1 time: 0.160336 Nov 23 09:01:04.450047 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 213/412] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:04 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:04.536111 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-b0103451-f2b2-469c-a3f5-1019e070a4bb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:04.544034 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-b0103451-f2b2-469c-a3f5-1019e070a4bb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:04.545575 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-b0103451-f2b2-469c-a3f5-1019e070a4bb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:04.546724 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-b0103451-f2b2-469c-a3f5-1019e070a4bb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1724 microversion: 2.20 time: 0.156561 Nov 23 09:01:04.547281 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 200/413] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:04 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 09:01:05.467613 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a09ec17f-5624-4bd2-a195-215577b898bb tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:05.468148 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a09ec17f-5624-4bd2-a195-215577b898bb tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:05.474412 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a09ec17f-5624-4bd2-a195-215577b898bb tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:05.474857 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a09ec17f-5624-4bd2-a195-215577b898bb tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:05.475626 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a09ec17f-5624-4bd2-a195-215577b898bb tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:05.476056 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a09ec17f-5624-4bd2-a195-215577b898bb tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:05.565375 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-9111aa8f-60ac-4697-b686-698d803c9032 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:05.566079 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-9111aa8f-60ac-4697-b686-698d803c9032 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:05.572332 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9111aa8f-60ac-4697-b686-698d803c9032 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:05.572780 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9111aa8f-60ac-4697-b686-698d803c9032 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:05.573599 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9111aa8f-60ac-4697-b686-698d803c9032 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:05.574038 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9111aa8f-60ac-4697-b686-698d803c9032 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:05.605003 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a09ec17f-5624-4bd2-a195-215577b898bb tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:05.614515 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a09ec17f-5624-4bd2-a195-215577b898bb tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1566 microversion: 2.1 time: 0.151571 Nov 23 09:01:05.624383 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 214/414] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:05 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:05.715846 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-9111aa8f-60ac-4697-b686-698d803c9032 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:05.724089 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-9111aa8f-60ac-4697-b686-698d803c9032 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:05.725596 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-9111aa8f-60ac-4697-b686-698d803c9032 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:05.726994 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-9111aa8f-60ac-4697-b686-698d803c9032 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1724 microversion: 2.20 time: 0.165228 Nov 23 09:01:05.733219 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 201/415] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:05 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 09:01:06.631543 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-ff5860eb-405e-4f66-a583-a7737926e0bc tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:06.632145 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-ff5860eb-405e-4f66-a583-a7737926e0bc tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:06.638334 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ff5860eb-405e-4f66-a583-a7737926e0bc tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:06.638782 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ff5860eb-405e-4f66-a583-a7737926e0bc tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:06.639547 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ff5860eb-405e-4f66-a583-a7737926e0bc tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:06.639979 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ff5860eb-405e-4f66-a583-a7737926e0bc tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:06.746735 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-6c2823cf-8c23-4b21-9416-6f315729020a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:06.747350 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-6c2823cf-8c23-4b21-9416-6f315729020a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:06.754381 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6c2823cf-8c23-4b21-9416-6f315729020a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:06.754923 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6c2823cf-8c23-4b21-9416-6f315729020a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:06.755913 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6c2823cf-8c23-4b21-9416-6f315729020a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:06.756423 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6c2823cf-8c23-4b21-9416-6f315729020a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:06.771523 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-ff5860eb-405e-4f66-a583-a7737926e0bc tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:06.779306 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-ff5860eb-405e-4f66-a583-a7737926e0bc tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1566 microversion: 2.1 time: 0.151369 Nov 23 09:01:06.779875 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 215/416] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:06 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:06.901792 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-6c2823cf-8c23-4b21-9416-6f315729020a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:06.909992 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-6c2823cf-8c23-4b21-9416-6f315729020a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:06.911614 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-6c2823cf-8c23-4b21-9416-6f315729020a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:06.912948 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-6c2823cf-8c23-4b21-9416-6f315729020a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1724 microversion: 2.20 time: 0.170583 Nov 23 09:01:06.913637 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 202/417] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:06 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:01:07.797033 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-92ba2300-4eb3-4c5c-94b1-5c14b36527ce tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:07.797954 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-92ba2300-4eb3-4c5c-94b1-5c14b36527ce tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:07.804383 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-92ba2300-4eb3-4c5c-94b1-5c14b36527ce tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:07.804930 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-92ba2300-4eb3-4c5c-94b1-5c14b36527ce tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:07.805930 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-92ba2300-4eb3-4c5c-94b1-5c14b36527ce tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:07.806444 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-92ba2300-4eb3-4c5c-94b1-5c14b36527ce tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:07.931256 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-78c1d4d2-fb42-441d-a6ef-44ae6634dfd6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:07.931905 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-78c1d4d2-fb42-441d-a6ef-44ae6634dfd6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:07.947496 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-78c1d4d2-fb42-441d-a6ef-44ae6634dfd6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:07.950631 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-78c1d4d2-fb42-441d-a6ef-44ae6634dfd6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:07.952359 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-78c1d4d2-fb42-441d-a6ef-44ae6634dfd6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:07.952838 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-78c1d4d2-fb42-441d-a6ef-44ae6634dfd6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:07.969470 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-92ba2300-4eb3-4c5c-94b1-5c14b36527ce tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:07.978636 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-92ba2300-4eb3-4c5c-94b1-5c14b36527ce tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1566 microversion: 2.1 time: 0.186083 Nov 23 09:01:07.979216 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 216/418] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:07 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1566 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:01:08.157189 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-78c1d4d2-fb42-441d-a6ef-44ae6634dfd6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:08.166074 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-78c1d4d2-fb42-441d-a6ef-44ae6634dfd6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:08.168468 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-78c1d4d2-fb42-441d-a6ef-44ae6634dfd6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:08.169850 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-78c1d4d2-fb42-441d-a6ef-44ae6634dfd6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1724 microversion: 2.20 time: 0.242509 Nov 23 09:01:08.170498 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 203/419] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:07 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:01:09.003558 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-2c4e9444-e66c-400e-bd59-62bd74a72ba8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:09.004199 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-2c4e9444-e66c-400e-bd59-62bd74a72ba8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:09.022653 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2c4e9444-e66c-400e-bd59-62bd74a72ba8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:09.023364 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2c4e9444-e66c-400e-bd59-62bd74a72ba8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:09.024175 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2c4e9444-e66c-400e-bd59-62bd74a72ba8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:09.024620 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2c4e9444-e66c-400e-bd59-62bd74a72ba8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:09.171871 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-2c4e9444-e66c-400e-bd59-62bd74a72ba8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:09.179729 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-2c4e9444-e66c-400e-bd59-62bd74a72ba8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1566 microversion: 2.1 time: 0.187713 Nov 23 09:01:09.180285 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 217/420] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:08 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1566 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:09.193486 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-7f29e620-4407-418d-9d9c-3e33b0f7301b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:09.194085 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-7f29e620-4407-418d-9d9c-3e33b0f7301b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:09.201045 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7f29e620-4407-418d-9d9c-3e33b0f7301b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:09.201459 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7f29e620-4407-418d-9d9c-3e33b0f7301b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:09.202228 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7f29e620-4407-418d-9d9c-3e33b0f7301b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:09.202661 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7f29e620-4407-418d-9d9c-3e33b0f7301b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:09.334441 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-7f29e620-4407-418d-9d9c-3e33b0f7301b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:09.343067 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-7f29e620-4407-418d-9d9c-3e33b0f7301b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:09.344661 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-7f29e620-4407-418d-9d9c-3e33b0f7301b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:09.345854 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-7f29e620-4407-418d-9d9c-3e33b0f7301b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1724 microversion: 2.20 time: 0.156428 Nov 23 09:01:09.346439 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 204/421] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:09 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:01:10.196823 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-75ab7aa4-ab2e-45dd-b6a9-2622bd6b8ad2 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:10.197470 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-75ab7aa4-ab2e-45dd-b6a9-2622bd6b8ad2 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:10.204464 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-75ab7aa4-ab2e-45dd-b6a9-2622bd6b8ad2 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:10.204910 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-75ab7aa4-ab2e-45dd-b6a9-2622bd6b8ad2 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:10.205708 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-75ab7aa4-ab2e-45dd-b6a9-2622bd6b8ad2 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:10.206143 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-75ab7aa4-ab2e-45dd-b6a9-2622bd6b8ad2 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:10.338347 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-75ab7aa4-ab2e-45dd-b6a9-2622bd6b8ad2 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:10.346537 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-75ab7aa4-ab2e-45dd-b6a9-2622bd6b8ad2 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1566 microversion: 2.1 time: 0.153352 Nov 23 09:01:10.347110 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 218/422] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:10 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:10.363452 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-c0a3f847-6cea-4a44-b22a-beb1e7ef9f10 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:10.364052 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-c0a3f847-6cea-4a44-b22a-beb1e7ef9f10 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:10.370264 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c0a3f847-6cea-4a44-b22a-beb1e7ef9f10 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:10.370711 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c0a3f847-6cea-4a44-b22a-beb1e7ef9f10 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:10.372337 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c0a3f847-6cea-4a44-b22a-beb1e7ef9f10 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:10.372767 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c0a3f847-6cea-4a44-b22a-beb1e7ef9f10 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:10.500251 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-c0a3f847-6cea-4a44-b22a-beb1e7ef9f10 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:10.507942 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-c0a3f847-6cea-4a44-b22a-beb1e7ef9f10 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:10.509498 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-c0a3f847-6cea-4a44-b22a-beb1e7ef9f10 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:10.510641 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-c0a3f847-6cea-4a44-b22a-beb1e7ef9f10 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1724 microversion: 2.20 time: 0.150877 Nov 23 09:01:10.511218 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 205/423] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:10 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:01:11.364411 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-6ce7221f-a575-4937-9a99-abc63e2a962b tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:11.364924 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-6ce7221f-a575-4937-9a99-abc63e2a962b tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:11.371768 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6ce7221f-a575-4937-9a99-abc63e2a962b tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:11.372308 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6ce7221f-a575-4937-9a99-abc63e2a962b tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:11.373082 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6ce7221f-a575-4937-9a99-abc63e2a962b tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:11.373544 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6ce7221f-a575-4937-9a99-abc63e2a962b tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:11.501423 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-6ce7221f-a575-4937-9a99-abc63e2a962b tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:11.509002 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-6ce7221f-a575-4937-9a99-abc63e2a962b tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1566 microversion: 2.1 time: 0.148362 Nov 23 09:01:11.509621 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 219/424] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:11 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:11.529248 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-d9894471-1137-4a6e-9ded-46dbd8efc2df tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:11.529913 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-d9894471-1137-4a6e-9ded-46dbd8efc2df tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:11.536133 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d9894471-1137-4a6e-9ded-46dbd8efc2df tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:11.536588 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d9894471-1137-4a6e-9ded-46dbd8efc2df tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:11.537413 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d9894471-1137-4a6e-9ded-46dbd8efc2df tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:11.537889 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d9894471-1137-4a6e-9ded-46dbd8efc2df tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:11.669805 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-d9894471-1137-4a6e-9ded-46dbd8efc2df tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:11.677488 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-d9894471-1137-4a6e-9ded-46dbd8efc2df tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:11.678996 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-d9894471-1137-4a6e-9ded-46dbd8efc2df tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:11.680145 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-d9894471-1137-4a6e-9ded-46dbd8efc2df tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1724 microversion: 2.20 time: 0.155209 Nov 23 09:01:11.680705 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 206/425] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:11 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:01:12.337046 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-6589a5e7-3cc7-48f6-bad5-a2cb933f7164 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-796058940", "imageRef": "18424a16-ac32-42d5-8161-d6cb36423de3", "flavorRef": "452", "networks": [{"uuid": "3885b5b6-3fad-407d-ad1a-570b02daaee7"}]}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:01:12.389819 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.network.neutron [None req-6589a5e7-3cc7-48f6-bad5-a2cb933f7164 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] validate_networks() for [('3885b5b6-3fad-407d-ad1a-570b02daaee7', None, None, None, None, None)] {{(pid=116226) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 09:01:12.526450 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-21376a84-b1b8-49a0-bcf9-0f7b409e874e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:12.527241 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-21376a84-b1b8-49a0-bcf9-0f7b409e874e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:12.534383 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-21376a84-b1b8-49a0-bcf9-0f7b409e874e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:12.534949 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-21376a84-b1b8-49a0-bcf9-0f7b409e874e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:12.535699 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-21376a84-b1b8-49a0-bcf9-0f7b409e874e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:12.536144 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-21376a84-b1b8-49a0-bcf9-0f7b409e874e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:12.679298 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-21376a84-b1b8-49a0-bcf9-0f7b409e874e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:12.687436 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-21376a84-b1b8-49a0-bcf9-0f7b409e874e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1566 microversion: 2.1 time: 0.164926 Nov 23 09:01:12.688025 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 207/426] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:12 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:01:12.698249 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-45b0f0b5-82df-4b37-a1fc-94d241c70d71 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:12.698874 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-45b0f0b5-82df-4b37-a1fc-94d241c70d71 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:12.705283 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-45b0f0b5-82df-4b37-a1fc-94d241c70d71 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:12.705735 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-45b0f0b5-82df-4b37-a1fc-94d241c70d71 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:12.706514 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-45b0f0b5-82df-4b37-a1fc-94d241c70d71 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:12.706950 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-45b0f0b5-82df-4b37-a1fc-94d241c70d71 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:12.742580 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-6589a5e7-3cc7-48f6-bad5-a2cb933f7164 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Flavor limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 09:01:12.742994 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-6589a5e7-3cc7-48f6-bad5-a2cb933f7164 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Image limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 09:01:12.743464 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-6589a5e7-3cc7-48f6-bad5-a2cb933f7164 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Flavor pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 09:01:12.743872 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-6589a5e7-3cc7-48f6-bad5-a2cb933f7164 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Image pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 09:01:12.744280 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-6589a5e7-3cc7-48f6-bad5-a2cb933f7164 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 09:01:12.752978 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6589a5e7-3cc7-48f6-bad5-a2cb933f7164 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:12.753641 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6589a5e7-3cc7-48f6-bad5-a2cb933f7164 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:12.754462 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6589a5e7-3cc7-48f6-bad5-a2cb933f7164 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:12.755522 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6589a5e7-3cc7-48f6-bad5-a2cb933f7164 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:12.772243 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-6589a5e7-3cc7-48f6-bad5-a2cb933f7164 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Getting quotas for project cc96d46a97c943aca49c42bd6ba512a7. Resources: {'instances', 'ram', 'cores'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 09:01:12.776156 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-6589a5e7-3cc7-48f6-bad5-a2cb933f7164 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Getting quotas for user 9aab4af24a784bd29062cfb1f27e37b8 and project cc96d46a97c943aca49c42bd6ba512a7. Resources: {'instances', 'ram', 'cores'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 09:01:12.787016 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-6589a5e7-3cc7-48f6-bad5-a2cb933f7164 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Going to run 1 instances... {{(pid=116226) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 09:01:12.789355 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-6589a5e7-3cc7-48f6-bad5-a2cb933f7164 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: d24b89a9-3395-4744-8c8c-7cb14a68dae6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='18424a16-ac32-42d5-8161-d6cb36423de3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116226) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 09:01:12.842280 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-45b0f0b5-82df-4b37-a1fc-94d241c70d71 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:12.842446 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-6589a5e7-3cc7-48f6-bad5-a2cb933f7164 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.508788 Nov 23 09:01:12.843248 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 220/427] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 23 09:01:12 2021] POST /compute/v2.1/servers => generated 380 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 23 09:01:12.851548 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-45b0f0b5-82df-4b37-a1fc-94d241c70d71 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:12.852476 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c77ddaa0-7027-4e9e-b327-96dc37679bc8 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:12.853091 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c77ddaa0-7027-4e9e-b327-96dc37679bc8 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: d24b89a9-3395-4744-8c8c-7cb14a68dae6] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:12.853442 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-45b0f0b5-82df-4b37-a1fc-94d241c70d71 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:12.854732 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-45b0f0b5-82df-4b37-a1fc-94d241c70d71 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1724 microversion: 2.20 time: 0.160076 Nov 23 09:01:12.856274 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 208/428] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:12 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:01:12.911277 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-c77ddaa0-7027-4e9e-b327-96dc37679bc8 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:12.919097 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c77ddaa0-7027-4e9e-b327-96dc37679bc8 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6" status: 200 len: 1218 microversion: 2.1 time: 0.069803 Nov 23 09:01:12.919979 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 221/429] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:12 2021] GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6 => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:01:13.440715 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-5d499e6e-e189-4dc5-ab71-4d1c050a1633 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:13.441310 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-5d499e6e-e189-4dc5-ab71-4d1c050a1633 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 468f160d-19b7-4d4c-a51a-a74c32cc4d75] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:13.449230 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5d499e6e-e189-4dc5-ab71-4d1c050a1633 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:13.449770 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5d499e6e-e189-4dc5-ab71-4d1c050a1633 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:13.450789 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5d499e6e-e189-4dc5-ab71-4d1c050a1633 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:13.451503 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5d499e6e-e189-4dc5-ab71-4d1c050a1633 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:13.539840 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.objects.instance [None req-5d499e6e-e189-4dc5-ab71-4d1c050a1633 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lazy-loading 'services' on Instance uuid 468f160d-19b7-4d4c-a51a-a74c32cc4d75 {{(pid=116227) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 09:01:13.612598 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-5d499e6e-e189-4dc5-ab71-4d1c050a1633 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "DELETE /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75/os-volume_attachments/51db3046-9005-46c8-adc7-23a8328239dc" status: 202 len: 0 microversion: 2.1 time: 0.175631 Nov 23 09:01:13.613562 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 209/430] 10.222.0.46 () {58 vars in 1415 bytes} [Tue Nov 23 09:01:13 2021] DELETE /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75/os-volume_attachments/51db3046-9005-46c8-adc7-23a8328239dc => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:01:13.622083 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-ef919c06-5f9d-4edf-800f-14c49330cc54 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:13.623052 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-ef919c06-5f9d-4edf-800f-14c49330cc54 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 468f160d-19b7-4d4c-a51a-a74c32cc4d75] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:13.629595 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ef919c06-5f9d-4edf-800f-14c49330cc54 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:13.630026 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ef919c06-5f9d-4edf-800f-14c49330cc54 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:13.630806 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ef919c06-5f9d-4edf-800f-14c49330cc54 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:13.631409 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ef919c06-5f9d-4edf-800f-14c49330cc54 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:13.662696 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-ef919c06-5f9d-4edf-800f-14c49330cc54 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044759 Nov 23 09:01:13.663262 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 222/431] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 23 09:01:13 2021] GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:01:13.705757 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-edf65d27-7449-4530-9fd8-403cd266e2e2 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:13.706458 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-edf65d27-7449-4530-9fd8-403cd266e2e2 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:13.712527 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-edf65d27-7449-4530-9fd8-403cd266e2e2 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:13.713134 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-edf65d27-7449-4530-9fd8-403cd266e2e2 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:13.714470 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-edf65d27-7449-4530-9fd8-403cd266e2e2 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:13.715053 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-edf65d27-7449-4530-9fd8-403cd266e2e2 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:13.873676 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-5a0e2af0-f35a-4d11-a079-373854d2e540 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:13.874696 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-5a0e2af0-f35a-4d11-a079-373854d2e540 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:13.880987 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5a0e2af0-f35a-4d11-a079-373854d2e540 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:13.881605 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5a0e2af0-f35a-4d11-a079-373854d2e540 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:13.882490 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5a0e2af0-f35a-4d11-a079-373854d2e540 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:13.883032 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5a0e2af0-f35a-4d11-a079-373854d2e540 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:13.917321 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-edf65d27-7449-4530-9fd8-403cd266e2e2 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:13.930625 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-edf65d27-7449-4530-9fd8-403cd266e2e2 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1566 microversion: 2.1 time: 0.226616 Nov 23 09:01:13.930625 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 210/432] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:13 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1566 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:13.943740 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-598175a3-34f0-49de-b9b8-a6161308c41e tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:13.944383 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-598175a3-34f0-49de-b9b8-a6161308c41e tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: d24b89a9-3395-4744-8c8c-7cb14a68dae6] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:13.954121 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-598175a3-34f0-49de-b9b8-a6161308c41e tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:13.954629 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-598175a3-34f0-49de-b9b8-a6161308c41e tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:13.955493 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-598175a3-34f0-49de-b9b8-a6161308c41e tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:13.955932 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-598175a3-34f0-49de-b9b8-a6161308c41e tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:14.027555 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-598175a3-34f0-49de-b9b8-a6161308c41e tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:14.035969 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-598175a3-34f0-49de-b9b8-a6161308c41e tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6" status: 200 len: 1278 microversion: 2.1 time: 0.103751 Nov 23 09:01:14.036730 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 211/433] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:13 2021] GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6 => generated 1278 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:01:14.154133 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-5a0e2af0-f35a-4d11-a079-373854d2e540 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:14.162829 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-5a0e2af0-f35a-4d11-a079-373854d2e540 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:14.164432 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-5a0e2af0-f35a-4d11-a079-373854d2e540 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:14.165612 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-5a0e2af0-f35a-4d11-a079-373854d2e540 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1745 microversion: 2.20 time: 0.296220 Nov 23 09:01:14.166343 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 223/434] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:13 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1745 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 09:01:14.674735 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-7522f8af-08b8-4309-85f9-c749494dcd33 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:14.675651 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-7522f8af-08b8-4309-85f9-c749494dcd33 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 468f160d-19b7-4d4c-a51a-a74c32cc4d75] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:14.684848 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7522f8af-08b8-4309-85f9-c749494dcd33 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:14.685351 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7522f8af-08b8-4309-85f9-c749494dcd33 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:14.686161 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7522f8af-08b8-4309-85f9-c749494dcd33 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:14.687293 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7522f8af-08b8-4309-85f9-c749494dcd33 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:14.721613 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-7522f8af-08b8-4309-85f9-c749494dcd33 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050879 Nov 23 09:01:14.722446 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 212/435] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 23 09:01:14 2021] GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 09:01:14.946628 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-7c5c7b75-0be9-44ab-b2b9-35cd59518e09 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:14.947230 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-7c5c7b75-0be9-44ab-b2b9-35cd59518e09 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:14.953410 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7c5c7b75-0be9-44ab-b2b9-35cd59518e09 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:14.953861 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7c5c7b75-0be9-44ab-b2b9-35cd59518e09 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:14.954635 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7c5c7b75-0be9-44ab-b2b9-35cd59518e09 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:14.955068 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7c5c7b75-0be9-44ab-b2b9-35cd59518e09 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:15.054251 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-dd17c43b-4f4f-42b9-9587-19fa90535623 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:15.054859 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-dd17c43b-4f4f-42b9-9587-19fa90535623 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: d24b89a9-3395-4744-8c8c-7cb14a68dae6] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:15.061280 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-dd17c43b-4f4f-42b9-9587-19fa90535623 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:15.061730 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-dd17c43b-4f4f-42b9-9587-19fa90535623 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:15.062514 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-dd17c43b-4f4f-42b9-9587-19fa90535623 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:15.062953 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-dd17c43b-4f4f-42b9-9587-19fa90535623 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:15.205895 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-dd17c43b-4f4f-42b9-9587-19fa90535623 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:15.214102 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-dd17c43b-4f4f-42b9-9587-19fa90535623 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6" status: 200 len: 1318 microversion: 2.1 time: 0.163532 Nov 23 09:01:15.215491 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 213/436] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:15 2021] GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:01:15.220507 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-1e8214ad-d93b-41a8-ad96-eacaa3d4793e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:15.221109 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-1e8214ad-d93b-41a8-ad96-eacaa3d4793e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:15.227476 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1e8214ad-d93b-41a8-ad96-eacaa3d4793e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:15.227935 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1e8214ad-d93b-41a8-ad96-eacaa3d4793e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:15.228718 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1e8214ad-d93b-41a8-ad96-eacaa3d4793e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:15.229154 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1e8214ad-d93b-41a8-ad96-eacaa3d4793e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:15.243048 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-7c5c7b75-0be9-44ab-b2b9-35cd59518e09 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:15.251550 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-7c5c7b75-0be9-44ab-b2b9-35cd59518e09 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1566 microversion: 2.1 time: 0.308495 Nov 23 09:01:15.252433 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 224/437] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:14 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1566 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:15.367109 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-1e8214ad-d93b-41a8-ad96-eacaa3d4793e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:15.375641 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-1e8214ad-d93b-41a8-ad96-eacaa3d4793e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:15.377142 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-1e8214ad-d93b-41a8-ad96-eacaa3d4793e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:15.378312 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-1e8214ad-d93b-41a8-ad96-eacaa3d4793e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1745 microversion: 2.20 time: 0.161642 Nov 23 09:01:15.378872 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 214/438] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:15 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:01:15.739216 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-1e6356f0-cb4f-411f-813f-950ca44838a8 req-af130b02-24ef-4815-ae5f-4f08f7905579 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d24b89a9-3395-4744-8c8c-7cb14a68dae6", "tag": "5e0eff58-402c-44b7-93a7-cb46a2d7e9b1"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:01:15.740869 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:01:15.740869 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 09:01:15.753680 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-1e6356f0-cb4f-411f-813f-950ca44838a8 req-af130b02-24ef-4815-ae5f-4f08f7905579 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:15.754896 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-1e6356f0-cb4f-411f-813f-950ca44838a8 req-af130b02-24ef-4815-ae5f-4f08f7905579 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:15.773289 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-1e6356f0-cb4f-411f-813f-950ca44838a8 req-af130b02-24ef-4815-ae5f-4f08f7905579 service nova] Creating event network-changed:5e0eff58-402c-44b7-93a7-cb46a2d7e9b1 for instance d24b89a9-3395-4744-8c8c-7cb14a68dae6 on hv-cinder-76845 Nov 23 09:01:15.778461 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-1e6356f0-cb4f-411f-813f-950ca44838a8 req-af130b02-24ef-4815-ae5f-4f08f7905579 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042818 Nov 23 09:01:15.779066 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 225/439] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:01:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:01:15.924080 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-3df9748f-1729-4bc7-a239-43eb445318ea tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:15.924611 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-3df9748f-1729-4bc7-a239-43eb445318ea tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 468f160d-19b7-4d4c-a51a-a74c32cc4d75] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:15.934800 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3df9748f-1729-4bc7-a239-43eb445318ea tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:15.935269 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3df9748f-1729-4bc7-a239-43eb445318ea tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:15.936205 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3df9748f-1729-4bc7-a239-43eb445318ea tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:15.936931 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3df9748f-1729-4bc7-a239-43eb445318ea tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:15.977081 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-3df9748f-1729-4bc7-a239-43eb445318ea tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 468f160d-19b7-4d4c-a51a-a74c32cc4d75] Going to try to terminate instance {{(pid=116227) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 09:01:16.078467 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-3df9748f-1729-4bc7-a239-43eb445318ea tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "DELETE /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75" status: 204 len: 0 microversion: 2.1 time: 0.158594 Nov 23 09:01:16.079206 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 215/440] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 23 09:01:15 2021] DELETE /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 09:01:16.102375 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f0709e06-375f-468d-bce9-90af9ae9fc20 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:16.103121 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f0709e06-375f-468d-bce9-90af9ae9fc20 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 468f160d-19b7-4d4c-a51a-a74c32cc4d75] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:16.117468 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f0709e06-375f-468d-bce9-90af9ae9fc20 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:16.118278 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f0709e06-375f-468d-bce9-90af9ae9fc20 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:16.119348 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f0709e06-375f-468d-bce9-90af9ae9fc20 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:16.121463 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f0709e06-375f-468d-bce9-90af9ae9fc20 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:16.235848 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-53c37121-eeaa-4125-a634-5aa5f6da45ea tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:16.237046 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-53c37121-eeaa-4125-a634-5aa5f6da45ea tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: d24b89a9-3395-4744-8c8c-7cb14a68dae6] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:16.244849 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-53c37121-eeaa-4125-a634-5aa5f6da45ea tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:16.245676 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-53c37121-eeaa-4125-a634-5aa5f6da45ea tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:16.246836 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-53c37121-eeaa-4125-a634-5aa5f6da45ea tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:16.247450 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-53c37121-eeaa-4125-a634-5aa5f6da45ea tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:16.531928 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-f0709e06-375f-468d-bce9-90af9ae9fc20 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:16.544041 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f0709e06-375f-468d-bce9-90af9ae9fc20 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75" status: 200 len: 1512 microversion: 2.1 time: 0.453869 Nov 23 09:01:16.544911 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 226/441] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:16 2021] GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75 => generated 1512 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:16.562276 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-1b873428-7c40-4d45-ba2a-9e0236c30d27 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:16.563054 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-1b873428-7c40-4d45-ba2a-9e0236c30d27 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:16.580081 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1b873428-7c40-4d45-ba2a-9e0236c30d27 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:16.582747 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1b873428-7c40-4d45-ba2a-9e0236c30d27 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:16.583879 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1b873428-7c40-4d45-ba2a-9e0236c30d27 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:16.588399 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1b873428-7c40-4d45-ba2a-9e0236c30d27 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:16.720639 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-53c37121-eeaa-4125-a634-5aa5f6da45ea tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:16.728293 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-53c37121-eeaa-4125-a634-5aa5f6da45ea tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6" status: 200 len: 1318 microversion: 2.1 time: 0.496856 Nov 23 09:01:16.731386 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 216/442] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:16 2021] GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6 => generated 1318 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:01:16.736105 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-7ccbcf1e-0ada-4185-ad21-771d9b470411 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:16.750099 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-7ccbcf1e-0ada-4185-ad21-771d9b470411 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:16.756377 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7ccbcf1e-0ada-4185-ad21-771d9b470411 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:16.756968 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7ccbcf1e-0ada-4185-ad21-771d9b470411 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:16.757877 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7ccbcf1e-0ada-4185-ad21-771d9b470411 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:16.758483 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7ccbcf1e-0ada-4185-ad21-771d9b470411 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:16.834283 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-1b873428-7c40-4d45-ba2a-9e0236c30d27 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:16.851317 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-1b873428-7c40-4d45-ba2a-9e0236c30d27 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1566 microversion: 2.1 time: 0.293056 Nov 23 09:01:16.854142 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 227/443] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:16 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1566 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:17.037548 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-7ccbcf1e-0ada-4185-ad21-771d9b470411 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:17.049690 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-7ccbcf1e-0ada-4185-ad21-771d9b470411 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:17.051526 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-7ccbcf1e-0ada-4185-ad21-771d9b470411 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:17.054834 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-7ccbcf1e-0ada-4185-ad21-771d9b470411 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1740 microversion: 2.20 time: 0.322222 Nov 23 09:01:17.057801 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 217/444] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:16 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1740 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:01:17.563173 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f7301ed5-b12a-41ce-ae1b-53ca03e72905 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:17.564109 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f7301ed5-b12a-41ce-ae1b-53ca03e72905 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 468f160d-19b7-4d4c-a51a-a74c32cc4d75] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:17.577330 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f7301ed5-b12a-41ce-ae1b-53ca03e72905 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:17.577792 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f7301ed5-b12a-41ce-ae1b-53ca03e72905 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:17.579232 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f7301ed5-b12a-41ce-ae1b-53ca03e72905 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:17.579677 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f7301ed5-b12a-41ce-ae1b-53ca03e72905 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:17.754943 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-025fd1ca-5063-42e3-a497-2793d4f23643 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:17.755805 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-025fd1ca-5063-42e3-a497-2793d4f23643 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: d24b89a9-3395-4744-8c8c-7cb14a68dae6] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:17.767675 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-025fd1ca-5063-42e3-a497-2793d4f23643 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:17.768127 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-025fd1ca-5063-42e3-a497-2793d4f23643 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:17.769529 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-025fd1ca-5063-42e3-a497-2793d4f23643 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:17.770089 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-025fd1ca-5063-42e3-a497-2793d4f23643 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:17.776838 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-f7301ed5-b12a-41ce-ae1b-53ca03e72905 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:17.786359 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f7301ed5-b12a-41ce-ae1b-53ca03e72905 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75" status: 200 len: 1512 microversion: 2.1 time: 0.227643 Nov 23 09:01:17.787759 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 228/445] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:17 2021] GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75 => generated 1512 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:17.870457 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-250b2d4a-0159-43dc-ab3c-f65a3bc0a1f7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:17.871807 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-250b2d4a-0159-43dc-ab3c-f65a3bc0a1f7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:17.883744 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-250b2d4a-0159-43dc-ab3c-f65a3bc0a1f7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:17.884207 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-250b2d4a-0159-43dc-ab3c-f65a3bc0a1f7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:17.885597 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-250b2d4a-0159-43dc-ab3c-f65a3bc0a1f7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:17.886510 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-250b2d4a-0159-43dc-ab3c-f65a3bc0a1f7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:18.066198 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-025fd1ca-5063-42e3-a497-2793d4f23643 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:18.075551 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-025fd1ca-5063-42e3-a497-2793d4f23643 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6" status: 200 len: 1318 microversion: 2.1 time: 0.324223 Nov 23 09:01:18.076138 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 218/446] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:17 2021] GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6 => generated 1318 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:01:18.080471 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-cd763439-33e9-4b8a-93ba-5301a8912fca tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:18.081075 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-cd763439-33e9-4b8a-93ba-5301a8912fca tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:18.112454 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-cd763439-33e9-4b8a-93ba-5301a8912fca tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:18.112974 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-cd763439-33e9-4b8a-93ba-5301a8912fca tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:18.114099 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-cd763439-33e9-4b8a-93ba-5301a8912fca tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:18.114969 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-cd763439-33e9-4b8a-93ba-5301a8912fca tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:18.127444 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-250b2d4a-0159-43dc-ab3c-f65a3bc0a1f7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:18.136097 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-250b2d4a-0159-43dc-ab3c-f65a3bc0a1f7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1566 microversion: 2.1 time: 0.269229 Nov 23 09:01:18.146902 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 229/447] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:17 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1566 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:18.229716 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-71416698-a695-4296-b0b4-19516da82b60 req-3e2b9ba5-822d-4d2d-840f-6ab23445de46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82569d71-833c-454b-a668-12dc9a37e7e2", "name": "network-vif-plugged", "status": "completed", "tag": "efe7e8ac-f495-4361-902c-7da559e50715"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:01:18.232071 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:01:18.232071 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 09:01:18.243509 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-71416698-a695-4296-b0b4-19516da82b60 req-3e2b9ba5-822d-4d2d-840f-6ab23445de46 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:18.244233 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-71416698-a695-4296-b0b4-19516da82b60 req-3e2b9ba5-822d-4d2d-840f-6ab23445de46 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:18.280463 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-71416698-a695-4296-b0b4-19516da82b60 req-3e2b9ba5-822d-4d2d-840f-6ab23445de46 service nova] Creating event network-vif-plugged:efe7e8ac-f495-4361-902c-7da559e50715 for instance 82569d71-833c-454b-a668-12dc9a37e7e2 on hv-cinder-76845 Nov 23 09:01:18.289527 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-71416698-a695-4296-b0b4-19516da82b60 req-3e2b9ba5-822d-4d2d-840f-6ab23445de46 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061665 Nov 23 09:01:18.290762 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 230/448] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:01:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 09:01:18.470788 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-cd763439-33e9-4b8a-93ba-5301a8912fca tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:18.487074 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-cd763439-33e9-4b8a-93ba-5301a8912fca tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:18.492258 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-cd763439-33e9-4b8a-93ba-5301a8912fca tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:18.495774 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-cd763439-33e9-4b8a-93ba-5301a8912fca tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1740 microversion: 2.20 time: 0.418491 Nov 23 09:01:18.501927 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 219/449] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:18 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1740 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:01:18.807542 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-3138b09d-9407-4e47-9acc-776a1bcf1517 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:18.808310 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-3138b09d-9407-4e47-9acc-776a1bcf1517 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 468f160d-19b7-4d4c-a51a-a74c32cc4d75] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:18.819001 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3138b09d-9407-4e47-9acc-776a1bcf1517 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:18.819460 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3138b09d-9407-4e47-9acc-776a1bcf1517 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:18.820262 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3138b09d-9407-4e47-9acc-776a1bcf1517 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:18.824474 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3138b09d-9407-4e47-9acc-776a1bcf1517 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:19.103225 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-12a82719-f7c0-49b1-99b9-0118abffc126 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:19.104464 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-12a82719-f7c0-49b1-99b9-0118abffc126 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: d24b89a9-3395-4744-8c8c-7cb14a68dae6] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:19.134967 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-12a82719-f7c0-49b1-99b9-0118abffc126 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:19.138601 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-12a82719-f7c0-49b1-99b9-0118abffc126 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:19.140490 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-12a82719-f7c0-49b1-99b9-0118abffc126 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:19.141101 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-12a82719-f7c0-49b1-99b9-0118abffc126 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:19.245961 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-3138b09d-9407-4e47-9acc-776a1bcf1517 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:19.254108 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-3138b09d-9407-4e47-9acc-776a1bcf1517 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75" status: 200 len: 1512 microversion: 2.1 time: 0.451028 Nov 23 09:01:19.257871 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 231/450] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:18 2021] GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75 => generated 1512 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:19.271663 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d26177d9-1634-43ba-b5d1-e9be5280ca01 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:19.279696 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d26177d9-1634-43ba-b5d1-e9be5280ca01 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:19.301281 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d26177d9-1634-43ba-b5d1-e9be5280ca01 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:19.302204 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d26177d9-1634-43ba-b5d1-e9be5280ca01 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:19.303444 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d26177d9-1634-43ba-b5d1-e9be5280ca01 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:19.304127 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d26177d9-1634-43ba-b5d1-e9be5280ca01 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:19.596567 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d26177d9-1634-43ba-b5d1-e9be5280ca01 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:19.606286 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d26177d9-1634-43ba-b5d1-e9be5280ca01 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1566 microversion: 2.1 time: 0.346686 Nov 23 09:01:19.620678 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 232/451] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:19 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1566 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:19.620678 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e27addef-e1ae-444a-9e0b-b69d352e2340 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:19.620678 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e27addef-e1ae-444a-9e0b-b69d352e2340 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:19.621725 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-12a82719-f7c0-49b1-99b9-0118abffc126 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:19.633112 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-12a82719-f7c0-49b1-99b9-0118abffc126 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6" status: 200 len: 1318 microversion: 2.1 time: 0.543667 Nov 23 09:01:19.634099 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 220/452] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:19 2021] GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6 => generated 1318 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:19.648134 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e27addef-e1ae-444a-9e0b-b69d352e2340 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:19.650284 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e27addef-e1ae-444a-9e0b-b69d352e2340 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:19.651655 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e27addef-e1ae-444a-9e0b-b69d352e2340 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:19.652336 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e27addef-e1ae-444a-9e0b-b69d352e2340 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:20.064260 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-6213e2b7-8d96-4907-a7eb-675704d05b4a req-6bcab825-0e13-4196-849e-bc0e61800325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "468f160d-19b7-4d4c-a51a-a74c32cc4d75", "name": "network-vif-deleted", "tag": "b57d2fa5-0e4c-480c-a153-ec9850be0754"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:01:20.067517 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:01:20.067517 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 09:01:20.105489 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-6213e2b7-8d96-4907-a7eb-675704d05b4a req-6bcab825-0e13-4196-849e-bc0e61800325 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:20.106666 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-6213e2b7-8d96-4907-a7eb-675704d05b4a req-6bcab825-0e13-4196-849e-bc0e61800325 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:20.138511 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-6213e2b7-8d96-4907-a7eb-675704d05b4a req-6bcab825-0e13-4196-849e-bc0e61800325 service nova] Creating event network-vif-deleted:b57d2fa5-0e4c-480c-a153-ec9850be0754 for instance 468f160d-19b7-4d4c-a51a-a74c32cc4d75 on hv-cinder-76845 Nov 23 09:01:20.152441 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-6213e2b7-8d96-4907-a7eb-675704d05b4a req-6bcab825-0e13-4196-849e-bc0e61800325 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092336 Nov 23 09:01:20.155686 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 221/453] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:01:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:01:20.274387 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-9e318802-1d89-444d-b7fe-4f3e891dd444 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:20.275430 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-9e318802-1d89-444d-b7fe-4f3e891dd444 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 468f160d-19b7-4d4c-a51a-a74c32cc4d75] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:20.291034 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9e318802-1d89-444d-b7fe-4f3e891dd444 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:20.291756 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9e318802-1d89-444d-b7fe-4f3e891dd444 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:20.293966 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9e318802-1d89-444d-b7fe-4f3e891dd444 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:20.295462 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9e318802-1d89-444d-b7fe-4f3e891dd444 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:20.325187 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-e27addef-e1ae-444a-9e0b-b69d352e2340 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:20.349371 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-e27addef-e1ae-444a-9e0b-b69d352e2340 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:20.355030 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9e318802-1d89-444d-b7fe-4f3e891dd444 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:20.355788 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-e27addef-e1ae-444a-9e0b-b69d352e2340 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:20.356372 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9e318802-1d89-444d-b7fe-4f3e891dd444 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:20.357566 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.objects.instance [None req-9e318802-1d89-444d-b7fe-4f3e891dd444 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lazy-loading 'fault' on Instance uuid 468f160d-19b7-4d4c-a51a-a74c32cc4d75 {{(pid=116227) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 09:01:20.360014 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e27addef-e1ae-444a-9e0b-b69d352e2340 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1740 microversion: 2.20 time: 0.745779 Nov 23 09:01:20.363803 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 233/454] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:19 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1740 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:01:20.560359 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-9e318802-1d89-444d-b7fe-4f3e891dd444 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:20.572783 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-9e318802-1d89-444d-b7fe-4f3e891dd444 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75" status: 200 len: 1307 microversion: 2.1 time: 0.302982 Nov 23 09:01:20.573639 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 222/455] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:20 2021] GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75 => generated 1307 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:20.637384 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8094fa5d-0da9-4276-a35a-d61c4f826fb2 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:20.638290 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-8094fa5d-0da9-4276-a35a-d61c4f826fb2 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:20.650822 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-6fe03a29-1deb-4626-8d32-18e6996eebd9 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:20.653134 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-6fe03a29-1deb-4626-8d32-18e6996eebd9 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: d24b89a9-3395-4744-8c8c-7cb14a68dae6] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:20.653826 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8094fa5d-0da9-4276-a35a-d61c4f826fb2 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:20.655839 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8094fa5d-0da9-4276-a35a-d61c4f826fb2 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:20.656875 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8094fa5d-0da9-4276-a35a-d61c4f826fb2 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:20.658259 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8094fa5d-0da9-4276-a35a-d61c4f826fb2 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:20.667491 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6fe03a29-1deb-4626-8d32-18e6996eebd9 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:20.667985 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6fe03a29-1deb-4626-8d32-18e6996eebd9 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:20.670570 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6fe03a29-1deb-4626-8d32-18e6996eebd9 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:20.671205 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6fe03a29-1deb-4626-8d32-18e6996eebd9 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:20.905985 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-8094fa5d-0da9-4276-a35a-d61c4f826fb2 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:20.919885 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-8094fa5d-0da9-4276-a35a-d61c4f826fb2 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1566 microversion: 2.1 time: 0.295346 Nov 23 09:01:20.923841 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 234/456] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:20 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1566 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:21.334838 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-6fe03a29-1deb-4626-8d32-18e6996eebd9 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:21.343200 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-6fe03a29-1deb-4626-8d32-18e6996eebd9 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6" status: 200 len: 1318 microversion: 2.1 time: 0.696858 Nov 23 09:01:21.356921 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 223/457] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:20 2021] GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6 => generated 1318 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:01:21.382441 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-9bd5a0ca-0964-48ea-b1c1-80866a6c1122 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:21.383059 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-9bd5a0ca-0964-48ea-b1c1-80866a6c1122 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:21.390712 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9bd5a0ca-0964-48ea-b1c1-80866a6c1122 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:21.391147 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9bd5a0ca-0964-48ea-b1c1-80866a6c1122 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:21.392009 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9bd5a0ca-0964-48ea-b1c1-80866a6c1122 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:21.392448 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9bd5a0ca-0964-48ea-b1c1-80866a6c1122 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:21.592059 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-0fc64d2f-d95c-40fa-9509-ea7160cd3f9b tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:21.592918 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-0fc64d2f-d95c-40fa-9509-ea7160cd3f9b tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 468f160d-19b7-4d4c-a51a-a74c32cc4d75] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:21.614498 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0fc64d2f-d95c-40fa-9509-ea7160cd3f9b tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:21.615144 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0fc64d2f-d95c-40fa-9509-ea7160cd3f9b tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:21.616227 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0fc64d2f-d95c-40fa-9509-ea7160cd3f9b tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:21.617014 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0fc64d2f-d95c-40fa-9509-ea7160cd3f9b tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:21.642513 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-9bd5a0ca-0964-48ea-b1c1-80866a6c1122 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:21.643692 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.wsgi [None req-0fc64d2f-d95c-40fa-9509-ea7160cd3f9b tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] HTTP exception thrown: Instance 468f160d-19b7-4d4c-a51a-a74c32cc4d75 could not be found. Nov 23 09:01:21.644696 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-0fc64d2f-d95c-40fa-9509-ea7160cd3f9b tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Returning 404 to user: Instance 468f160d-19b7-4d4c-a51a-a74c32cc4d75 could not be found. {{(pid=116227) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 09:01:21.645835 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-0fc64d2f-d95c-40fa-9509-ea7160cd3f9b tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75" status: 404 len: 111 microversion: 2.1 time: 0.059701 Nov 23 09:01:21.646656 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 224/458] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:21 2021] GET /compute/v2.1/servers/468f160d-19b7-4d4c-a51a-a74c32cc4d75 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 09:01:21.659234 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-9bd5a0ca-0964-48ea-b1c1-80866a6c1122 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:21.662184 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-9bd5a0ca-0964-48ea-b1c1-80866a6c1122 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:21.663821 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-9bd5a0ca-0964-48ea-b1c1-80866a6c1122 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1740 microversion: 2.20 time: 0.285115 Nov 23 09:01:21.676306 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 235/459] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:21 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1740 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:01:21.938553 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-17a12036-af16-44f9-810b-7193cbef36dd tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:21.940159 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-17a12036-af16-44f9-810b-7193cbef36dd tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:21.955465 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-17a12036-af16-44f9-810b-7193cbef36dd tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:21.957481 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-17a12036-af16-44f9-810b-7193cbef36dd tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:21.959266 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-17a12036-af16-44f9-810b-7193cbef36dd tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:21.962815 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-17a12036-af16-44f9-810b-7193cbef36dd tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:22.363659 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-161b3e54-5555-4fd6-92eb-10336e8082dc tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:22.364744 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-161b3e54-5555-4fd6-92eb-10336e8082dc tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: d24b89a9-3395-4744-8c8c-7cb14a68dae6] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:22.373947 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-161b3e54-5555-4fd6-92eb-10336e8082dc tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:22.377902 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-161b3e54-5555-4fd6-92eb-10336e8082dc tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:22.378990 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-161b3e54-5555-4fd6-92eb-10336e8082dc tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:22.379437 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-161b3e54-5555-4fd6-92eb-10336e8082dc tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:22.405680 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-17a12036-af16-44f9-810b-7193cbef36dd tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:22.450846 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-17a12036-af16-44f9-810b-7193cbef36dd tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1566 microversion: 2.1 time: 0.513393 Nov 23 09:01:22.451831 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 225/460] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:21 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1566 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:22.608083 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-161b3e54-5555-4fd6-92eb-10336e8082dc tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:22.616971 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-161b3e54-5555-4fd6-92eb-10336e8082dc tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6" status: 200 len: 1318 microversion: 2.1 time: 0.256882 Nov 23 09:01:22.617591 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 236/461] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:22 2021] GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6 => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:01:22.695567 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-caac8e92-5eb7-4c37-8863-c4a896100121 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:22.696557 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-caac8e92-5eb7-4c37-8863-c4a896100121 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:22.704521 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-caac8e92-5eb7-4c37-8863-c4a896100121 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:22.705398 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-caac8e92-5eb7-4c37-8863-c4a896100121 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:22.706473 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-caac8e92-5eb7-4c37-8863-c4a896100121 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:22.707141 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-caac8e92-5eb7-4c37-8863-c4a896100121 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:22.926271 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-caac8e92-5eb7-4c37-8863-c4a896100121 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:22.941899 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-caac8e92-5eb7-4c37-8863-c4a896100121 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:22.946922 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-caac8e92-5eb7-4c37-8863-c4a896100121 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:22.948647 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-caac8e92-5eb7-4c37-8863-c4a896100121 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1740 microversion: 2.20 time: 0.263119 Nov 23 09:01:22.958423 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-1fb8a323-2442-44b2-8c2b-ca78dde130b0 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:22.959001 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-1fb8a323-2442-44b2-8c2b-ca78dde130b0 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 280ce860-8611-44bc-9aa5-0409d2e36937] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:22.965006 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 226/462] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:22 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1740 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:01:22.967109 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1fb8a323-2442-44b2-8c2b-ca78dde130b0 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:22.967679 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1fb8a323-2442-44b2-8c2b-ca78dde130b0 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:22.968735 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1fb8a323-2442-44b2-8c2b-ca78dde130b0 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:22.969276 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1fb8a323-2442-44b2-8c2b-ca78dde130b0 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:22.999723 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-1fb8a323-2442-44b2-8c2b-ca78dde130b0 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 280ce860-8611-44bc-9aa5-0409d2e36937] Going to try to terminate instance {{(pid=116226) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 09:01:23.131350 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-1fb8a323-2442-44b2-8c2b-ca78dde130b0 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "DELETE /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937" status: 204 len: 0 microversion: 2.1 time: 0.177246 Nov 23 09:01:23.143167 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-f37dee27-aa40-4043-ba39-99667d35331f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:23.144188 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-f37dee27-aa40-4043-ba39-99667d35331f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 280ce860-8611-44bc-9aa5-0409d2e36937] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:23.151684 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 237/463] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 23 09:01:22 2021] DELETE /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 23 09:01:23.153004 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f37dee27-aa40-4043-ba39-99667d35331f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:23.154439 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f37dee27-aa40-4043-ba39-99667d35331f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:23.155491 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f37dee27-aa40-4043-ba39-99667d35331f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:23.156140 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f37dee27-aa40-4043-ba39-99667d35331f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:23.365436 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-f37dee27-aa40-4043-ba39-99667d35331f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:23.373915 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-f37dee27-aa40-4043-ba39-99667d35331f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937" status: 200 len: 1513 microversion: 2.1 time: 0.237532 Nov 23 09:01:23.377480 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 227/464] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:23 2021] GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937 => generated 1513 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:23.471562 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-3659240f-3e9f-4e21-a517-29968d226b2a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:23.472266 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-3659240f-3e9f-4e21-a517-29968d226b2a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:23.487011 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3659240f-3e9f-4e21-a517-29968d226b2a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:23.487459 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3659240f-3e9f-4e21-a517-29968d226b2a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:23.488444 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3659240f-3e9f-4e21-a517-29968d226b2a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:23.489039 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3659240f-3e9f-4e21-a517-29968d226b2a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:23.635212 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-3a8f13db-079d-4d07-8527-6c2122083775 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:23.636085 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-3a8f13db-079d-4d07-8527-6c2122083775 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: d24b89a9-3395-4744-8c8c-7cb14a68dae6] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:23.647886 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3a8f13db-079d-4d07-8527-6c2122083775 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:23.648529 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3a8f13db-079d-4d07-8527-6c2122083775 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:23.649515 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3a8f13db-079d-4d07-8527-6c2122083775 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:23.650057 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3a8f13db-079d-4d07-8527-6c2122083775 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:23.695136 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-3659240f-3e9f-4e21-a517-29968d226b2a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:23.704755 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-3659240f-3e9f-4e21-a517-29968d226b2a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1566 microversion: 2.1 time: 0.238047 Nov 23 09:01:23.738157 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 238/465] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:23 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1566 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:23.918325 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-3a8f13db-079d-4d07-8527-6c2122083775 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:23.929618 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-3a8f13db-079d-4d07-8527-6c2122083775 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6" status: 200 len: 1318 microversion: 2.1 time: 0.298322 Nov 23 09:01:23.930491 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 228/466] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:23 2021] GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6 => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:23.972319 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-82dc913a-5b97-4258-878b-ddf3166ffb81 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:23.972319 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-82dc913a-5b97-4258-878b-ddf3166ffb81 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:23.977490 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-82dc913a-5b97-4258-878b-ddf3166ffb81 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:23.980924 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-82dc913a-5b97-4258-878b-ddf3166ffb81 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:23.980924 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-82dc913a-5b97-4258-878b-ddf3166ffb81 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:23.980924 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-82dc913a-5b97-4258-878b-ddf3166ffb81 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:24.174962 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-82dc913a-5b97-4258-878b-ddf3166ffb81 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:24.190558 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-82dc913a-5b97-4258-878b-ddf3166ffb81 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:24.196909 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-82dc913a-5b97-4258-878b-ddf3166ffb81 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:24.199484 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-82dc913a-5b97-4258-878b-ddf3166ffb81 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1740 microversion: 2.20 time: 0.233210 Nov 23 09:01:24.209153 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 239/467] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:23 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1740 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:01:24.394411 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-53dd9cb5-7726-4bc4-a204-e24451d5bc72 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:24.395496 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-53dd9cb5-7726-4bc4-a204-e24451d5bc72 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 280ce860-8611-44bc-9aa5-0409d2e36937] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:24.405654 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-53dd9cb5-7726-4bc4-a204-e24451d5bc72 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:24.408915 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-53dd9cb5-7726-4bc4-a204-e24451d5bc72 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:24.410007 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-53dd9cb5-7726-4bc4-a204-e24451d5bc72 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:24.413555 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-53dd9cb5-7726-4bc4-a204-e24451d5bc72 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:24.700912 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-53dd9cb5-7726-4bc4-a204-e24451d5bc72 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:24.714544 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-53dd9cb5-7726-4bc4-a204-e24451d5bc72 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937" status: 200 len: 1513 microversion: 2.1 time: 0.323888 Nov 23 09:01:24.719767 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 229/468] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:24 2021] GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937 => generated 1513 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:24.737721 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-0a05e0f3-6101-4094-a312-e445bf1852ca tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:24.738462 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-0a05e0f3-6101-4094-a312-e445bf1852ca tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:24.744903 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0a05e0f3-6101-4094-a312-e445bf1852ca tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:24.745717 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0a05e0f3-6101-4094-a312-e445bf1852ca tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:24.746737 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0a05e0f3-6101-4094-a312-e445bf1852ca tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:24.747354 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0a05e0f3-6101-4094-a312-e445bf1852ca tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:24.909710 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-47ac0159-3a15-4187-9e24-8faa8cd61fad req-4cdfd658-d4fa-45d4-a87d-f7d4117c12cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d24b89a9-3395-4744-8c8c-7cb14a68dae6", "name": "network-vif-plugged", "status": "completed", "tag": "5e0eff58-402c-44b7-93a7-cb46a2d7e9b1"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:01:24.917419 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:01:24.917419 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 09:01:24.953860 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-47ac0159-3a15-4187-9e24-8faa8cd61fad req-4cdfd658-d4fa-45d4-a87d-f7d4117c12cd service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:24.954755 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-47ac0159-3a15-4187-9e24-8faa8cd61fad req-4cdfd658-d4fa-45d4-a87d-f7d4117c12cd service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:24.987145 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-47ac0159-3a15-4187-9e24-8faa8cd61fad req-4cdfd658-d4fa-45d4-a87d-f7d4117c12cd service nova] Creating event network-vif-plugged:5e0eff58-402c-44b7-93a7-cb46a2d7e9b1 for instance d24b89a9-3395-4744-8c8c-7cb14a68dae6 on hv-cinder-76845 Nov 23 09:01:24.997096 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-47ac0159-3a15-4187-9e24-8faa8cd61fad req-4cdfd658-d4fa-45d4-a87d-f7d4117c12cd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093512 Nov 23 09:01:24.998286 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 230/469] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:01:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 09:01:25.005763 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-d29341dc-e1e7-4164-aa97-7a3bf29aa917 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:25.007698 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-d29341dc-e1e7-4164-aa97-7a3bf29aa917 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: d24b89a9-3395-4744-8c8c-7cb14a68dae6] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:25.026231 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d29341dc-e1e7-4164-aa97-7a3bf29aa917 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:25.026997 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d29341dc-e1e7-4164-aa97-7a3bf29aa917 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:25.028524 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d29341dc-e1e7-4164-aa97-7a3bf29aa917 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:25.029123 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d29341dc-e1e7-4164-aa97-7a3bf29aa917 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:25.103682 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-0a05e0f3-6101-4094-a312-e445bf1852ca tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:25.114760 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-0a05e0f3-6101-4094-a312-e445bf1852ca tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1546 microversion: 2.1 time: 0.382253 Nov 23 09:01:25.116115 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 240/470] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:24 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1546 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:25.134487 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-9bc39cf7-ad08-45f1-97ab-7ce1c5d56734 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:25.135409 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-9bc39cf7-ad08-45f1-97ab-7ce1c5d56734 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:25.142176 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9bc39cf7-ad08-45f1-97ab-7ce1c5d56734 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:25.142990 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9bc39cf7-ad08-45f1-97ab-7ce1c5d56734 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:25.144217 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9bc39cf7-ad08-45f1-97ab-7ce1c5d56734 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:25.144864 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9bc39cf7-ad08-45f1-97ab-7ce1c5d56734 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:25.287358 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-9bc39cf7-ad08-45f1-97ab-7ce1c5d56734 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] HTTP exception thrown: Cannot 'detach_volume' instance 4e7614ff-90ad-4ed2-9d48-3b0585258f88 while it is in vm_state rescued Nov 23 09:01:25.288297 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-9bc39cf7-ad08-45f1-97ab-7ce1c5d56734 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Returning 409 to user: Cannot 'detach_volume' instance 4e7614ff-90ad-4ed2-9d48-3b0585258f88 while it is in vm_state rescued {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 09:01:25.289799 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-9bc39cf7-ad08-45f1-97ab-7ce1c5d56734 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88/os-volume_attachments/aa3b8c05-dd41-4bbb-9a09-7bd29536904a" status: 409 len: 152 microversion: 2.1 time: 0.160047 Nov 23 09:01:25.292211 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 241/471] 10.222.0.46 () {58 vars in 1415 bytes} [Tue Nov 23 09:01:25 2021] DELETE /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88/os-volume_attachments/aa3b8c05-dd41-4bbb-9a09-7bd29536904a => generated 152 bytes in 163 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 23 09:01:25.303936 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-1e0f124c-3943-4c47-bdad-a10debe49ff6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:25.306833 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-1e0f124c-3943-4c47-bdad-a10debe49ff6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:25.322134 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1e0f124c-3943-4c47-bdad-a10debe49ff6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:25.323211 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-d29341dc-e1e7-4164-aa97-7a3bf29aa917 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:25.325481 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1e0f124c-3943-4c47-bdad-a10debe49ff6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:25.329881 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1e0f124c-3943-4c47-bdad-a10debe49ff6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:25.330568 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1e0f124c-3943-4c47-bdad-a10debe49ff6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:25.332526 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-d29341dc-e1e7-4164-aa97-7a3bf29aa917 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6" status: 200 len: 1318 microversion: 2.1 time: 0.332780 Nov 23 09:01:25.333118 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 231/472] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:24 2021] GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6 => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:25.364949 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-24447444-3170-4719-8353-b75cb380aafe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:01:25.366071 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-24447444-3170-4719-8353-b75cb380aafe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:25.380785 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-24447444-3170-4719-8353-b75cb380aafe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:25.381830 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-24447444-3170-4719-8353-b75cb380aafe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:25.382923 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-24447444-3170-4719-8353-b75cb380aafe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:25.383553 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-24447444-3170-4719-8353-b75cb380aafe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:25.541409 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-24447444-3170-4719-8353-b75cb380aafe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "POST /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88/action" status: 202 len: 0 microversion: 2.1 time: 0.194839 Nov 23 09:01:25.542910 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 232/473] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:01:25 2021] POST /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:01:25.551500 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-a9092df2-4e9f-465c-bc56-0a1d212dbe68 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:25.552227 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-a9092df2-4e9f-465c-bc56-0a1d212dbe68 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:25.574575 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a9092df2-4e9f-465c-bc56-0a1d212dbe68 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:25.575074 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a9092df2-4e9f-465c-bc56-0a1d212dbe68 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:25.576132 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a9092df2-4e9f-465c-bc56-0a1d212dbe68 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:25.577394 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a9092df2-4e9f-465c-bc56-0a1d212dbe68 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:25.647149 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-1e0f124c-3943-4c47-bdad-a10debe49ff6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:25.663940 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-1e0f124c-3943-4c47-bdad-a10debe49ff6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:25.667027 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-1e0f124c-3943-4c47-bdad-a10debe49ff6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:25.672957 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-1e0f124c-3943-4c47-bdad-a10debe49ff6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1740 microversion: 2.20 time: 0.376505 Nov 23 09:01:25.674474 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 242/474] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:25 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1740 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:01:25.738164 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-851b03b6-0413-4b98-a495-ed1b505fd72c tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:25.739696 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-851b03b6-0413-4b98-a495-ed1b505fd72c tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 280ce860-8611-44bc-9aa5-0409d2e36937] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:25.769808 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-851b03b6-0413-4b98-a495-ed1b505fd72c tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:25.771570 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-851b03b6-0413-4b98-a495-ed1b505fd72c tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:25.777502 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-851b03b6-0413-4b98-a495-ed1b505fd72c tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:25.778249 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-851b03b6-0413-4b98-a495-ed1b505fd72c tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:25.983320 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-a9092df2-4e9f-465c-bc56-0a1d212dbe68 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:25.995869 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-a9092df2-4e9f-465c-bc56-0a1d212dbe68 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1554 microversion: 2.1 time: 0.446379 Nov 23 09:01:26.008431 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 233/475] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:25 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1554 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:26.218804 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-0d96055f-1830-4874-9a97-57c141cbf87d req-dc06b2a5-f23d-4046-9436-6ffaa84b695c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "280ce860-8611-44bc-9aa5-0409d2e36937", "name": "network-vif-deleted", "tag": "363a793f-0102-402a-a556-ccab80470b94"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:01:26.220768 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:01:26.220768 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 09:01:26.231279 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-0d96055f-1830-4874-9a97-57c141cbf87d req-dc06b2a5-f23d-4046-9436-6ffaa84b695c service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:26.231876 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-0d96055f-1830-4874-9a97-57c141cbf87d req-dc06b2a5-f23d-4046-9436-6ffaa84b695c service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:26.250196 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-0d96055f-1830-4874-9a97-57c141cbf87d req-dc06b2a5-f23d-4046-9436-6ffaa84b695c service nova] Creating event network-vif-deleted:363a793f-0102-402a-a556-ccab80470b94 for instance 280ce860-8611-44bc-9aa5-0409d2e36937 on hv-cinder-76845 Nov 23 09:01:26.258284 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-0d96055f-1830-4874-9a97-57c141cbf87d req-dc06b2a5-f23d-4046-9436-6ffaa84b695c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047199 Nov 23 09:01:26.263751 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 234/476] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:01:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:01:26.286497 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-851b03b6-0413-4b98-a495-ed1b505fd72c tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:26.298939 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-851b03b6-0413-4b98-a495-ed1b505fd72c tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937" status: 200 len: 1513 microversion: 2.1 time: 0.564550 Nov 23 09:01:26.300316 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 243/477] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:25 2021] GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937 => generated 1513 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:26.378359 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-295c5f7b-58fd-4565-82d9-1eddbc6d142c tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:26.384289 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-295c5f7b-58fd-4565-82d9-1eddbc6d142c tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: d24b89a9-3395-4744-8c8c-7cb14a68dae6] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:26.400744 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-295c5f7b-58fd-4565-82d9-1eddbc6d142c tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:26.412489 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-295c5f7b-58fd-4565-82d9-1eddbc6d142c tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:26.417486 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-295c5f7b-58fd-4565-82d9-1eddbc6d142c tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:26.419287 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-295c5f7b-58fd-4565-82d9-1eddbc6d142c tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:26.692769 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a66fa217-a602-4d38-920d-6007cd0f6f80 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:26.693615 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a66fa217-a602-4d38-920d-6007cd0f6f80 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:26.703506 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a66fa217-a602-4d38-920d-6007cd0f6f80 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:26.704242 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a66fa217-a602-4d38-920d-6007cd0f6f80 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:26.706256 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a66fa217-a602-4d38-920d-6007cd0f6f80 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:26.708164 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a66fa217-a602-4d38-920d-6007cd0f6f80 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:26.773884 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-295c5f7b-58fd-4565-82d9-1eddbc6d142c tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:26.787595 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-295c5f7b-58fd-4565-82d9-1eddbc6d142c tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6" status: 200 len: 1318 microversion: 2.1 time: 0.425603 Nov 23 09:01:26.806575 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 235/478] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:26 2021] GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6 => generated 1318 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:27.016971 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-af154c7f-407c-4f21-b420-1386780870ae tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:27.017889 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-af154c7f-407c-4f21-b420-1386780870ae tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:27.040854 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-af154c7f-407c-4f21-b420-1386780870ae tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:27.041707 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-af154c7f-407c-4f21-b420-1386780870ae tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:27.045845 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-af154c7f-407c-4f21-b420-1386780870ae tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:27.049125 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-af154c7f-407c-4f21-b420-1386780870ae tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:27.422761 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-af154c7f-407c-4f21-b420-1386780870ae tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:27.437735 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-af154c7f-407c-4f21-b420-1386780870ae tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1554 microversion: 2.1 time: 0.426720 Nov 23 09:01:27.443894 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 236/479] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:27 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1554 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:27.451706 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-d75ab58c-7264-4e38-bdce-5101dd37ce44 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:27.461470 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-d75ab58c-7264-4e38-bdce-5101dd37ce44 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 280ce860-8611-44bc-9aa5-0409d2e36937] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:27.476122 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d75ab58c-7264-4e38-bdce-5101dd37ce44 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:27.476636 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d75ab58c-7264-4e38-bdce-5101dd37ce44 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:27.477549 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d75ab58c-7264-4e38-bdce-5101dd37ce44 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:27.477990 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d75ab58c-7264-4e38-bdce-5101dd37ce44 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:27.507010 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.wsgi [None req-d75ab58c-7264-4e38-bdce-5101dd37ce44 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] HTTP exception thrown: Instance 280ce860-8611-44bc-9aa5-0409d2e36937 could not be found. Nov 23 09:01:27.507618 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-d75ab58c-7264-4e38-bdce-5101dd37ce44 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Returning 404 to user: Instance 280ce860-8611-44bc-9aa5-0409d2e36937 could not be found. {{(pid=116227) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 09:01:27.508584 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-d75ab58c-7264-4e38-bdce-5101dd37ce44 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937" status: 404 len: 111 microversion: 2.1 time: 0.062567 Nov 23 09:01:27.509406 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 237/480] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:27 2021] GET /compute/v2.1/servers/280ce860-8611-44bc-9aa5-0409d2e36937 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 09:01:27.520634 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-88a5f0f9-de64-438e-85b2-f602eae84037 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:27.521040 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-88a5f0f9-de64-438e-85b2-f602eae84037 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 3631a4c0-56e0-419b-8c2a-56dcbc6c0230] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:27.528404 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-88a5f0f9-de64-438e-85b2-f602eae84037 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:27.528860 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-88a5f0f9-de64-438e-85b2-f602eae84037 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:27.529886 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-88a5f0f9-de64-438e-85b2-f602eae84037 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:27.530327 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-88a5f0f9-de64-438e-85b2-f602eae84037 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:27.578608 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-88a5f0f9-de64-438e-85b2-f602eae84037 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 3631a4c0-56e0-419b-8c2a-56dcbc6c0230] Going to try to terminate instance {{(pid=116227) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 09:01:27.754964 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-88a5f0f9-de64-438e-85b2-f602eae84037 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230" status: 204 len: 0 microversion: 2.1 time: 0.238933 Nov 23 09:01:27.755562 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 238/481] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 23 09:01:27 2021] DELETE /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 23 09:01:27.767448 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-8a42a96a-8c2a-44d2-ae08-da8ea3c8b119 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:27.768159 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-8a42a96a-8c2a-44d2-ae08-da8ea3c8b119 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 3631a4c0-56e0-419b-8c2a-56dcbc6c0230] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:27.790698 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8a42a96a-8c2a-44d2-ae08-da8ea3c8b119 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:27.791470 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8a42a96a-8c2a-44d2-ae08-da8ea3c8b119 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:27.791891 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8a42a96a-8c2a-44d2-ae08-da8ea3c8b119 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:27.793567 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8a42a96a-8c2a-44d2-ae08-da8ea3c8b119 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:28.161585 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a66fa217-a602-4d38-920d-6007cd0f6f80 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:28.174719 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a66fa217-a602-4d38-920d-6007cd0f6f80 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:28.188130 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-8a42a96a-8c2a-44d2-ae08-da8ea3c8b119 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:28.204779 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a66fa217-a602-4d38-920d-6007cd0f6f80 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:28.211938 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a66fa217-a602-4d38-920d-6007cd0f6f80 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1740 microversion: 2.20 time: 1.524076 Nov 23 09:01:28.219390 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-8a42a96a-8c2a-44d2-ae08-da8ea3c8b119 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230" status: 200 len: 1512 microversion: 2.1 time: 0.458788 Nov 23 09:01:28.225560 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 239/482] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:27 2021] GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230 => generated 1512 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:01:28.226424 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 244/483] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:26 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1740 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 09:01:28.232338 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-c67cfa23-7c58-4102-a8df-4295504b6538 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:28.233079 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-c67cfa23-7c58-4102-a8df-4295504b6538 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: d24b89a9-3395-4744-8c8c-7cb14a68dae6] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:28.249815 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c67cfa23-7c58-4102-a8df-4295504b6538 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:28.254337 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c67cfa23-7c58-4102-a8df-4295504b6538 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:28.255843 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c67cfa23-7c58-4102-a8df-4295504b6538 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:28.258177 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c67cfa23-7c58-4102-a8df-4295504b6538 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:28.463738 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-cacb035c-f2b0-4aa9-b153-d2d848307a17 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:28.464449 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-cacb035c-f2b0-4aa9-b153-d2d848307a17 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:28.474801 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cacb035c-f2b0-4aa9-b153-d2d848307a17 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:28.477261 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cacb035c-f2b0-4aa9-b153-d2d848307a17 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:28.478135 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cacb035c-f2b0-4aa9-b153-d2d848307a17 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:28.480444 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cacb035c-f2b0-4aa9-b153-d2d848307a17 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:28.525721 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-c67cfa23-7c58-4102-a8df-4295504b6538 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:28.538141 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-c67cfa23-7c58-4102-a8df-4295504b6538 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6" status: 200 len: 1507 microversion: 2.1 time: 0.310780 Nov 23 09:01:28.550977 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 240/484] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:28 2021] GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6 => generated 1507 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:28.556175 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-2e7674f7-8054-4b18-a85d-81a777acc234 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b5795da-a5ff-4bf8-909d-4b8ddf12848d", "device": "/dev/sdb"}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:01:28.557350 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-2e7674f7-8054-4b18-a85d-81a777acc234 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: d24b89a9-3395-4744-8c8c-7cb14a68dae6] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:28.583304 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2e7674f7-8054-4b18-a85d-81a777acc234 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:28.583930 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2e7674f7-8054-4b18-a85d-81a777acc234 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:28.584998 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2e7674f7-8054-4b18-a85d-81a777acc234 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:28.591044 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2e7674f7-8054-4b18-a85d-81a777acc234 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:28.926550 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-cacb035c-f2b0-4aa9-b153-d2d848307a17 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:28.940650 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-cacb035c-f2b0-4aa9-b153-d2d848307a17 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1554 microversion: 2.1 time: 0.482017 Nov 23 09:01:28.952773 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 245/485] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:28 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1554 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:01:29.230580 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-aea6c816-e319-403f-a719-46723129a94c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:29.232306 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-aea6c816-e319-403f-a719-46723129a94c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:29.247586 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-aea6c816-e319-403f-a719-46723129a94c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:29.248384 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-aea6c816-e319-403f-a719-46723129a94c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:29.251929 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-aea6c816-e319-403f-a719-46723129a94c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:29.256128 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-aea6c816-e319-403f-a719-46723129a94c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:29.355737 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-2e7674f7-8054-4b18-a85d-81a777acc234 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "POST /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.801648 Nov 23 09:01:29.357189 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 241/486] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 23 09:01:28 2021] POST /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6/os-volume_attachments => generated 194 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:01:29.387997 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-5da06eca-00c8-43e9-8474-b47a558a6312 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:29.400068 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-5da06eca-00c8-43e9-8474-b47a558a6312 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 3631a4c0-56e0-419b-8c2a-56dcbc6c0230] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:29.432387 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5da06eca-00c8-43e9-8474-b47a558a6312 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:29.432822 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5da06eca-00c8-43e9-8474-b47a558a6312 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:29.433752 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5da06eca-00c8-43e9-8474-b47a558a6312 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:29.434197 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5da06eca-00c8-43e9-8474-b47a558a6312 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:29.753797 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-aea6c816-e319-403f-a719-46723129a94c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:29.763223 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-aea6c816-e319-403f-a719-46723129a94c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:29.773247 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-aea6c816-e319-403f-a719-46723129a94c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:29.775298 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-aea6c816-e319-403f-a719-46723129a94c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1740 microversion: 2.20 time: 0.548751 Nov 23 09:01:29.778843 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 246/487] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:29 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1740 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 09:01:29.958713 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f633d314-8958-49fd-8845-c22af22fea22 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:29.959232 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f633d314-8958-49fd-8845-c22af22fea22 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:29.972497 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f633d314-8958-49fd-8845-c22af22fea22 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:29.973701 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f633d314-8958-49fd-8845-c22af22fea22 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:29.977043 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f633d314-8958-49fd-8845-c22af22fea22 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:29.977842 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f633d314-8958-49fd-8845-c22af22fea22 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:30.155417 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-5da06eca-00c8-43e9-8474-b47a558a6312 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:30.172305 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-5da06eca-00c8-43e9-8474-b47a558a6312 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230" status: 200 len: 1512 microversion: 2.1 time: 0.812151 Nov 23 09:01:30.173956 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 242/488] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:29 2021] GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230 => generated 1512 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:30.640037 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-f633d314-8958-49fd-8845-c22af22fea22 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:30.649272 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f633d314-8958-49fd-8845-c22af22fea22 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1560 microversion: 2.1 time: 0.693847 Nov 23 09:01:30.649272 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 247/489] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:29 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1560 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:01:30.791768 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-45931628-4bd2-4f3a-9634-f7e85cda74ba tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:30.793392 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-45931628-4bd2-4f3a-9634-f7e85cda74ba tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:30.797523 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-334afba6-7905-450e-8620-27a04bc3b0f0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:30.798396 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-334afba6-7905-450e-8620-27a04bc3b0f0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:30.814012 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-45931628-4bd2-4f3a-9634-f7e85cda74ba tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:30.814776 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-45931628-4bd2-4f3a-9634-f7e85cda74ba tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:30.815760 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-45931628-4bd2-4f3a-9634-f7e85cda74ba tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:30.817325 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-334afba6-7905-450e-8620-27a04bc3b0f0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:30.817493 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-45931628-4bd2-4f3a-9634-f7e85cda74ba tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:30.818199 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-334afba6-7905-450e-8620-27a04bc3b0f0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:30.819258 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-334afba6-7905-450e-8620-27a04bc3b0f0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:30.830849 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-334afba6-7905-450e-8620-27a04bc3b0f0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:31.044477 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.objects.instance [None req-45931628-4bd2-4f3a-9634-f7e85cda74ba tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lazy-loading 'services' on Instance uuid 4e7614ff-90ad-4ed2-9d48-3b0585258f88 {{(pid=116227) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 09:01:31.124353 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-334afba6-7905-450e-8620-27a04bc3b0f0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:31.132908 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-334afba6-7905-450e-8620-27a04bc3b0f0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:31.134441 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-334afba6-7905-450e-8620-27a04bc3b0f0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:31.135648 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-334afba6-7905-450e-8620-27a04bc3b0f0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1740 microversion: 2.20 time: 0.343534 Nov 23 09:01:31.136221 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 248/490] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:30 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1740 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:01:31.150808 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-5c34a370-b9a4-426d-a5ee-84642888e901 req-72940740-b8bd-4090-85c3-c08ddaf4dbd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3631a4c0-56e0-419b-8c2a-56dcbc6c0230", "name": "network-vif-deleted", "tag": "cbdffd7c-afc7-47b2-9b90-e46f41e18a36"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:01:31.153295 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:01:31.153295 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 09:01:31.178345 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-5c34a370-b9a4-426d-a5ee-84642888e901 req-72940740-b8bd-4090-85c3-c08ddaf4dbd0 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:31.178957 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-5c34a370-b9a4-426d-a5ee-84642888e901 req-72940740-b8bd-4090-85c3-c08ddaf4dbd0 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:31.195730 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-45931628-4bd2-4f3a-9634-f7e85cda74ba tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88/os-volume_attachments/aa3b8c05-dd41-4bbb-9a09-7bd29536904a" status: 202 len: 0 microversion: 2.1 time: 0.408025 Nov 23 09:01:31.201936 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 243/491] 10.222.0.46 () {58 vars in 1415 bytes} [Tue Nov 23 09:01:30 2021] DELETE /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88/os-volume_attachments/aa3b8c05-dd41-4bbb-9a09-7bd29536904a => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:01:31.207048 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-5c34a370-b9a4-426d-a5ee-84642888e901 req-72940740-b8bd-4090-85c3-c08ddaf4dbd0 service nova] Creating event network-vif-deleted:cbdffd7c-afc7-47b2-9b90-e46f41e18a36 for instance 3631a4c0-56e0-419b-8c2a-56dcbc6c0230 on hv-cinder-76845 Nov 23 09:01:31.212613 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-e38e0a3e-6562-4780-96e5-8da702a78143 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:31.215171 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-e38e0a3e-6562-4780-96e5-8da702a78143 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 3631a4c0-56e0-419b-8c2a-56dcbc6c0230] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:31.220985 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-5c34a370-b9a4-426d-a5ee-84642888e901 req-72940740-b8bd-4090-85c3-c08ddaf4dbd0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073061 Nov 23 09:01:31.225738 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 249/492] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:01:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:01:31.228512 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e38e0a3e-6562-4780-96e5-8da702a78143 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:31.229866 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e38e0a3e-6562-4780-96e5-8da702a78143 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:31.231062 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e38e0a3e-6562-4780-96e5-8da702a78143 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:31.231749 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b28d93c1-6f0a-4ec9-86b5-1d48a8862bb5 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:31.232052 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e38e0a3e-6562-4780-96e5-8da702a78143 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:31.232827 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b28d93c1-6f0a-4ec9-86b5-1d48a8862bb5 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:31.246373 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b28d93c1-6f0a-4ec9-86b5-1d48a8862bb5 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:31.247052 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b28d93c1-6f0a-4ec9-86b5-1d48a8862bb5 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:31.249573 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b28d93c1-6f0a-4ec9-86b5-1d48a8862bb5 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:31.255212 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b28d93c1-6f0a-4ec9-86b5-1d48a8862bb5 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:31.302747 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e38e0a3e-6562-4780-96e5-8da702a78143 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:31.303381 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e38e0a3e-6562-4780-96e5-8da702a78143 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:31.303846 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.objects.instance [None req-e38e0a3e-6562-4780-96e5-8da702a78143 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lazy-loading 'fault' on Instance uuid 3631a4c0-56e0-419b-8c2a-56dcbc6c0230 {{(pid=116227) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 09:01:31.337127 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b28d93c1-6f0a-4ec9-86b5-1d48a8862bb5 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109472 Nov 23 09:01:31.338020 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 250/493] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 23 09:01:31 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:01:31.421721 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-e38e0a3e-6562-4780-96e5-8da702a78143 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:31.432635 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-e38e0a3e-6562-4780-96e5-8da702a78143 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230" status: 200 len: 1307 microversion: 2.1 time: 0.228348 Nov 23 09:01:31.433683 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 244/494] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:31 2021] GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230 => generated 1307 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:32.156873 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-6fa799aa-5636-42a9-8d16-e55454e83661 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:32.158497 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-6fa799aa-5636-42a9-8d16-e55454e83661 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:32.171578 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6fa799aa-5636-42a9-8d16-e55454e83661 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:32.172029 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6fa799aa-5636-42a9-8d16-e55454e83661 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:32.172993 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6fa799aa-5636-42a9-8d16-e55454e83661 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:32.173425 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6fa799aa-5636-42a9-8d16-e55454e83661 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:32.349507 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-3dad1dc3-7eb1-4209-b119-fa17f4423262 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:32.350483 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-3dad1dc3-7eb1-4209-b119-fa17f4423262 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:32.363871 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3dad1dc3-7eb1-4209-b119-fa17f4423262 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:32.364559 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3dad1dc3-7eb1-4209-b119-fa17f4423262 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:32.365400 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3dad1dc3-7eb1-4209-b119-fa17f4423262 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:32.366070 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3dad1dc3-7eb1-4209-b119-fa17f4423262 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:32.455420 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-3dad1dc3-7eb1-4209-b119-fa17f4423262 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109525 Nov 23 09:01:32.459442 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-6fa799aa-5636-42a9-8d16-e55454e83661 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:32.460321 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 245/495] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 23 09:01:32 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:01:32.467054 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-007678e5-9bc4-4bcf-bc22-0cdb840f533b tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:32.468039 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-007678e5-9bc4-4bcf-bc22-0cdb840f533b tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 3631a4c0-56e0-419b-8c2a-56dcbc6c0230] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:32.471636 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-6fa799aa-5636-42a9-8d16-e55454e83661 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:32.473638 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-6fa799aa-5636-42a9-8d16-e55454e83661 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:32.476280 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-007678e5-9bc4-4bcf-bc22-0cdb840f533b tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:32.477015 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-007678e5-9bc4-4bcf-bc22-0cdb840f533b tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:32.478183 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-007678e5-9bc4-4bcf-bc22-0cdb840f533b tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:32.478848 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-007678e5-9bc4-4bcf-bc22-0cdb840f533b tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:32.481734 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-6fa799aa-5636-42a9-8d16-e55454e83661 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1740 microversion: 2.20 time: 0.328261 Nov 23 09:01:32.482338 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 251/496] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:32 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1740 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:01:32.521433 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.wsgi [None req-007678e5-9bc4-4bcf-bc22-0cdb840f533b tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] HTTP exception thrown: Instance 3631a4c0-56e0-419b-8c2a-56dcbc6c0230 could not be found. Nov 23 09:01:32.526079 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-007678e5-9bc4-4bcf-bc22-0cdb840f533b tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Returning 404 to user: Instance 3631a4c0-56e0-419b-8c2a-56dcbc6c0230 could not be found. {{(pid=116227) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 09:01:32.527341 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-007678e5-9bc4-4bcf-bc22-0cdb840f533b tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230" status: 404 len: 111 microversion: 2.1 time: 0.065788 Nov 23 09:01:32.529499 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 246/497] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:32 2021] GET /compute/v2.1/servers/3631a4c0-56e0-419b-8c2a-56dcbc6c0230 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 09:01:33.249500 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-ffe81fa8-ce9b-4799-8a91-171f5520584d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Action: 'create', calling method: .version_select at 0x7f527a3e7c10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1835873804"}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:01:33.265261 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-ffe81fa8-ce9b-4799-8a91-171f5520584d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Getting quotas for project 229671159ee9412ca1bcc93a838c73c1. Resources: {'key_pairs'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 09:01:33.270055 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-ffe81fa8-ce9b-4799-8a91-171f5520584d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Getting quotas for user 8e26aa2383ab4e5da1bdc6712f58af06 and project 229671159ee9412ca1bcc93a838c73c1. Resources: {'key_pairs'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 09:01:33.469704 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-75331b59-6e09-4658-9570-e64584b8af50 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:33.471011 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-75331b59-6e09-4658-9570-e64584b8af50 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:33.479993 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-75331b59-6e09-4658-9570-e64584b8af50 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:33.480923 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-75331b59-6e09-4658-9570-e64584b8af50 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:33.481807 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-75331b59-6e09-4658-9570-e64584b8af50 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:33.482443 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-75331b59-6e09-4658-9570-e64584b8af50 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:33.509834 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-ffe81fa8-ce9b-4799-8a91-171f5520584d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Getting quotas for project 229671159ee9412ca1bcc93a838c73c1. Resources: {'key_pairs'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 09:01:33.515029 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-ffe81fa8-ce9b-4799-8a91-171f5520584d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Getting quotas for user 8e26aa2383ab4e5da1bdc6712f58af06 and project 229671159ee9412ca1bcc93a838c73c1. Resources: {'key_pairs'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 09:01:33.525448 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-75331b59-6e09-4658-9570-e64584b8af50 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061470 Nov 23 09:01:33.529876 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-ffe81fa8-ce9b-4799-8a91-171f5520584d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.498274 Nov 23 09:01:33.530948 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 247/498] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 23 09:01:33 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:01:33.531094 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 252/499] 10.222.0.46 () {60 vars in 1157 bytes} [Tue Nov 23 09:01:33 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:33.535418 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-170b3bf5-beaa-4c11-9671-f99d9a1e068b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:33.536815 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-170b3bf5-beaa-4c11-9671-f99d9a1e068b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:33.543768 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-170b3bf5-beaa-4c11-9671-f99d9a1e068b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:33.544227 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-170b3bf5-beaa-4c11-9671-f99d9a1e068b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:33.545230 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-170b3bf5-beaa-4c11-9671-f99d9a1e068b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:33.546343 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-170b3bf5-beaa-4c11-9671-f99d9a1e068b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:33.710593 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-170b3bf5-beaa-4c11-9671-f99d9a1e068b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:33.726419 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-170b3bf5-beaa-4c11-9671-f99d9a1e068b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:33.728394 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-170b3bf5-beaa-4c11-9671-f99d9a1e068b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:33.730862 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-170b3bf5-beaa-4c11-9671-f99d9a1e068b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1740 microversion: 2.20 time: 0.198050 Nov 23 09:01:33.742634 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 253/500] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:33 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1740 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:01:33.796159 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-9daa5f5f-47ee-479d-940a-8aed8fb8fdde tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:33.797134 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-9daa5f5f-47ee-479d-940a-8aed8fb8fdde tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 0f78026a-3a7c-46df-bc8b-8cf227c87354] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:33.817102 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9daa5f5f-47ee-479d-940a-8aed8fb8fdde tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:33.818129 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9daa5f5f-47ee-479d-940a-8aed8fb8fdde tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:33.824406 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9daa5f5f-47ee-479d-940a-8aed8fb8fdde tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:33.825240 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9daa5f5f-47ee-479d-940a-8aed8fb8fdde tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:33.894656 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-9daa5f5f-47ee-479d-940a-8aed8fb8fdde tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 0f78026a-3a7c-46df-bc8b-8cf227c87354] Going to try to terminate instance {{(pid=116227) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 09:01:34.032176 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-9daa5f5f-47ee-479d-940a-8aed8fb8fdde tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354" status: 204 len: 0 microversion: 2.1 time: 0.241219 Nov 23 09:01:34.034304 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 248/501] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 23 09:01:33 2021] DELETE /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 09:01:34.045281 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b93c71f3-ab95-418c-9598-b5bf64684b57 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:34.047592 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b93c71f3-ab95-418c-9598-b5bf64684b57 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 0f78026a-3a7c-46df-bc8b-8cf227c87354] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:34.054408 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b93c71f3-ab95-418c-9598-b5bf64684b57 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:34.055657 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b93c71f3-ab95-418c-9598-b5bf64684b57 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:34.056566 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b93c71f3-ab95-418c-9598-b5bf64684b57 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:34.057337 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b93c71f3-ab95-418c-9598-b5bf64684b57 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:34.342058 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b93c71f3-ab95-418c-9598-b5bf64684b57 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:34.350659 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b93c71f3-ab95-418c-9598-b5bf64684b57 tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354" status: 200 len: 1513 microversion: 2.1 time: 0.312292 Nov 23 09:01:34.352855 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 254/502] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:34 2021] GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354 => generated 1513 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:34.538695 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-f9e5696d-566b-4a78-bfe5-99fcacfe7e72 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:34.539926 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-f9e5696d-566b-4a78-bfe5-99fcacfe7e72 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:34.556286 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f9e5696d-566b-4a78-bfe5-99fcacfe7e72 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:34.556987 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f9e5696d-566b-4a78-bfe5-99fcacfe7e72 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:34.559149 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f9e5696d-566b-4a78-bfe5-99fcacfe7e72 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:34.560020 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f9e5696d-566b-4a78-bfe5-99fcacfe7e72 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:34.598941 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-f9e5696d-566b-4a78-bfe5-99fcacfe7e72 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064563 Nov 23 09:01:34.604556 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 249/503] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 23 09:01:34 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:01:34.756050 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-bc80b609-b9cc-4c64-96bf-d8e585bfbe38 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:34.757286 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-bc80b609-b9cc-4c64-96bf-d8e585bfbe38 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:34.767950 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bc80b609-b9cc-4c64-96bf-d8e585bfbe38 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:34.768806 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bc80b609-b9cc-4c64-96bf-d8e585bfbe38 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:34.770421 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bc80b609-b9cc-4c64-96bf-d8e585bfbe38 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:34.771212 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bc80b609-b9cc-4c64-96bf-d8e585bfbe38 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:35.113536 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-bc80b609-b9cc-4c64-96bf-d8e585bfbe38 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:35.123469 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-bc80b609-b9cc-4c64-96bf-d8e585bfbe38 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:35.125006 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-bc80b609-b9cc-4c64-96bf-d8e585bfbe38 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:35.126637 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-bc80b609-b9cc-4c64-96bf-d8e585bfbe38 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1740 microversion: 2.20 time: 0.378617 Nov 23 09:01:35.127578 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 255/504] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:34 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1740 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 09:01:35.372181 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-4828c71e-c8bb-4b7b-bd42-c082412e4c7e tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:35.373088 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-4828c71e-c8bb-4b7b-bd42-c082412e4c7e tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 0f78026a-3a7c-46df-bc8b-8cf227c87354] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:35.384445 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4828c71e-c8bb-4b7b-bd42-c082412e4c7e tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:35.384798 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4828c71e-c8bb-4b7b-bd42-c082412e4c7e tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:35.385890 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4828c71e-c8bb-4b7b-bd42-c082412e4c7e tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:35.386450 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4828c71e-c8bb-4b7b-bd42-c082412e4c7e tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:35.613543 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8bce6a1d-8326-44ef-a566-30da7c165c58 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:35.614563 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-8bce6a1d-8326-44ef-a566-30da7c165c58 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:35.626773 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8bce6a1d-8326-44ef-a566-30da7c165c58 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:35.627186 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8bce6a1d-8326-44ef-a566-30da7c165c58 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:35.628010 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8bce6a1d-8326-44ef-a566-30da7c165c58 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:35.628488 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8bce6a1d-8326-44ef-a566-30da7c165c58 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:35.632655 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-4828c71e-c8bb-4b7b-bd42-c082412e4c7e tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:35.670950 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-4828c71e-c8bb-4b7b-bd42-c082412e4c7e tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354" status: 200 len: 1513 microversion: 2.1 time: 0.302301 Nov 23 09:01:35.674524 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 250/505] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:35 2021] GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354 => generated 1513 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:35.691346 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-8bce6a1d-8326-44ef-a566-30da7c165c58 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083397 Nov 23 09:01:35.692614 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 256/506] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 23 09:01:35 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 09:01:36.146490 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-e03d5605-6243-4c6d-83d4-ca8fced5f969 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:36.147190 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-e03d5605-6243-4c6d-83d4-ca8fced5f969 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:36.160773 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e03d5605-6243-4c6d-83d4-ca8fced5f969 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:36.161259 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e03d5605-6243-4c6d-83d4-ca8fced5f969 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:36.162068 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e03d5605-6243-4c6d-83d4-ca8fced5f969 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:36.162505 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e03d5605-6243-4c6d-83d4-ca8fced5f969 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:36.462895 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-e03d5605-6243-4c6d-83d4-ca8fced5f969 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:36.484688 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-e03d5605-6243-4c6d-83d4-ca8fced5f969 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:36.487528 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-e03d5605-6243-4c6d-83d4-ca8fced5f969 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:36.491953 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-e03d5605-6243-4c6d-83d4-ca8fced5f969 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1740 microversion: 2.20 time: 0.351405 Nov 23 09:01:36.492880 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 251/507] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:36 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1740 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:01:36.690593 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-345e8e62-f48a-41ee-b0fd-e4812222cfed tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:36.691892 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-345e8e62-f48a-41ee-b0fd-e4812222cfed tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 0f78026a-3a7c-46df-bc8b-8cf227c87354] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:36.703985 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-16a0218b-b3d9-459e-ad23-9ffc93f66e40 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:36.704915 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-16a0218b-b3d9-459e-ad23-9ffc93f66e40 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:36.710697 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-345e8e62-f48a-41ee-b0fd-e4812222cfed tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:36.711518 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-345e8e62-f48a-41ee-b0fd-e4812222cfed tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:36.713081 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-16a0218b-b3d9-459e-ad23-9ffc93f66e40 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:36.714810 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-16a0218b-b3d9-459e-ad23-9ffc93f66e40 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:36.715828 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-16a0218b-b3d9-459e-ad23-9ffc93f66e40 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:36.715959 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-345e8e62-f48a-41ee-b0fd-e4812222cfed tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:36.719936 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-16a0218b-b3d9-459e-ad23-9ffc93f66e40 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:36.725621 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-345e8e62-f48a-41ee-b0fd-e4812222cfed tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:36.844100 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-16a0218b-b3d9-459e-ad23-9ffc93f66e40 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143466 Nov 23 09:01:36.851405 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 252/508] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 23 09:01:36 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 09:01:36.878376 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-0f909e1e-e4fc-4922-881b-06e519612cb1 req-950d3bc6-8632-466b-a8a2-0938da7fe4b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f78026a-3a7c-46df-bc8b-8cf227c87354", "name": "network-vif-deleted", "tag": "a8efe016-048d-473e-bb9a-b6758d97be0a"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:01:36.881460 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:01:36.881460 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 09:01:36.891824 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-0f909e1e-e4fc-4922-881b-06e519612cb1 req-950d3bc6-8632-466b-a8a2-0938da7fe4b3 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:36.893538 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-0f909e1e-e4fc-4922-881b-06e519612cb1 req-950d3bc6-8632-466b-a8a2-0938da7fe4b3 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:36.913301 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-0f909e1e-e4fc-4922-881b-06e519612cb1 req-950d3bc6-8632-466b-a8a2-0938da7fe4b3 service nova] Creating event network-vif-deleted:a8efe016-048d-473e-bb9a-b6758d97be0a for instance 0f78026a-3a7c-46df-bc8b-8cf227c87354 on hv-cinder-76845 Nov 23 09:01:36.919427 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-0f909e1e-e4fc-4922-881b-06e519612cb1 req-950d3bc6-8632-466b-a8a2-0938da7fe4b3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066360 Nov 23 09:01:36.920895 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 253/509] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:01:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:01:36.923821 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-345e8e62-f48a-41ee-b0fd-e4812222cfed tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642f1d3e0da400ebba9d029f63a95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f534070f974dc882ad415be1a1d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:36.935291 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-345e8e62-f48a-41ee-b0fd-e4812222cfed tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354" status: 200 len: 1471 microversion: 2.1 time: 0.246548 Nov 23 09:01:36.936963 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 257/510] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:36 2021] GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354 => generated 1471 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:37.512887 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-dc0b5c94-0d93-4dbd-86e7-c03aee644bec tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:37.513993 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-dc0b5c94-0d93-4dbd-86e7-c03aee644bec tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:37.522476 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-dc0b5c94-0d93-4dbd-86e7-c03aee644bec tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:37.522930 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-dc0b5c94-0d93-4dbd-86e7-c03aee644bec tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:37.524188 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-dc0b5c94-0d93-4dbd-86e7-c03aee644bec tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:37.525393 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-dc0b5c94-0d93-4dbd-86e7-c03aee644bec tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:37.722426 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-dc0b5c94-0d93-4dbd-86e7-c03aee644bec tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:37.732471 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-dc0b5c94-0d93-4dbd-86e7-c03aee644bec tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:37.735214 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-dc0b5c94-0d93-4dbd-86e7-c03aee644bec tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:37.736918 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-dc0b5c94-0d93-4dbd-86e7-c03aee644bec tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1722 microversion: 2.20 time: 0.229561 Nov 23 09:01:37.738101 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 254/511] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:37 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:01:37.858768 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-0554a042-1f2f-4b1b-b5f0-49301f7e615c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:37.859820 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-0554a042-1f2f-4b1b-b5f0-49301f7e615c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:37.867726 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0554a042-1f2f-4b1b-b5f0-49301f7e615c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:37.868184 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0554a042-1f2f-4b1b-b5f0-49301f7e615c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:37.869062 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0554a042-1f2f-4b1b-b5f0-49301f7e615c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:37.869556 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0554a042-1f2f-4b1b-b5f0-49301f7e615c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:37.905834 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-0554a042-1f2f-4b1b-b5f0-49301f7e615c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050850 Nov 23 09:01:37.906416 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 258/512] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 23 09:01:37 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 23 09:01:37.956846 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-dd45f235-7175-4294-85ba-2192481e201f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:37.957519 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-dd45f235-7175-4294-85ba-2192481e201f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] [instance: 0f78026a-3a7c-46df-bc8b-8cf227c87354] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:37.966547 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-dd45f235-7175-4294-85ba-2192481e201f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:37.967053 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-dd45f235-7175-4294-85ba-2192481e201f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:37.968005 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-dd45f235-7175-4294-85ba-2192481e201f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:37.970669 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-dd45f235-7175-4294-85ba-2192481e201f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:37.984793 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.wsgi [None req-dd45f235-7175-4294-85ba-2192481e201f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] HTTP exception thrown: Instance 0f78026a-3a7c-46df-bc8b-8cf227c87354 could not be found. Nov 23 09:01:37.985358 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-dd45f235-7175-4294-85ba-2192481e201f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] Returning 404 to user: Instance 0f78026a-3a7c-46df-bc8b-8cf227c87354 could not be found. {{(pid=116227) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 09:01:37.985874 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-dd45f235-7175-4294-85ba-2192481e201f tempest-AttachVolumeNegativeTest-1869775863 tempest-AttachVolumeNegativeTest-1869775863-project] 10.222.0.46 "GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354" status: 404 len: 111 microversion: 2.1 time: 0.035883 Nov 23 09:01:37.986620 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 255/513] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:37 2021] GET /compute/v2.1/servers/0f78026a-3a7c-46df-bc8b-8cf227c87354 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 09:01:38.761420 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-67148e40-57b0-4144-96bc-668f5fafcb63 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:38.761690 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-67148e40-57b0-4144-96bc-668f5fafcb63 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:38.769002 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-67148e40-57b0-4144-96bc-668f5fafcb63 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:38.769484 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-67148e40-57b0-4144-96bc-668f5fafcb63 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:38.770413 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-67148e40-57b0-4144-96bc-668f5fafcb63 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:38.771119 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-67148e40-57b0-4144-96bc-668f5fafcb63 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:38.931346 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-67148e40-57b0-4144-96bc-668f5fafcb63 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:38.939489 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-67148e40-57b0-4144-96bc-668f5fafcb63 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:38.940986 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-67148e40-57b0-4144-96bc-668f5fafcb63 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:38.942166 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-67148e40-57b0-4144-96bc-668f5fafcb63 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1722 microversion: 2.20 time: 0.186326 Nov 23 09:01:38.942721 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 259/514] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:38 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:01:39.962753 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-ef8c5e10-c448-4670-a824-db5ee9b92d1c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:39.963374 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-ef8c5e10-c448-4670-a824-db5ee9b92d1c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:39.970564 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ef8c5e10-c448-4670-a824-db5ee9b92d1c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:39.971012 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ef8c5e10-c448-4670-a824-db5ee9b92d1c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:39.971789 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ef8c5e10-c448-4670-a824-db5ee9b92d1c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:39.972221 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ef8c5e10-c448-4670-a824-db5ee9b92d1c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:40.117310 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-ef8c5e10-c448-4670-a824-db5ee9b92d1c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:40.128137 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-ef8c5e10-c448-4670-a824-db5ee9b92d1c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:40.129767 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-ef8c5e10-c448-4670-a824-db5ee9b92d1c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:40.130968 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-ef8c5e10-c448-4670-a824-db5ee9b92d1c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1722 microversion: 2.20 time: 0.171915 Nov 23 09:01:40.133327 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 256/515] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:39 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 09:01:41.150544 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a9d3a564-5254-4d57-875e-d4b3b0598ceb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:41.152141 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a9d3a564-5254-4d57-875e-d4b3b0598ceb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:41.160523 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a9d3a564-5254-4d57-875e-d4b3b0598ceb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:41.161891 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a9d3a564-5254-4d57-875e-d4b3b0598ceb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:41.162981 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a9d3a564-5254-4d57-875e-d4b3b0598ceb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:41.163711 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a9d3a564-5254-4d57-875e-d4b3b0598ceb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:41.459239 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a9d3a564-5254-4d57-875e-d4b3b0598ceb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:41.470644 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a9d3a564-5254-4d57-875e-d4b3b0598ceb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:41.472266 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a9d3a564-5254-4d57-875e-d4b3b0598ceb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:41.475420 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a9d3a564-5254-4d57-875e-d4b3b0598ceb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1722 microversion: 2.20 time: 0.326978 Nov 23 09:01:41.475760 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 260/516] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:41 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1722 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:01:42.389815 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-01d8dc1f-7f1d-4cf8-b75d-32a28fff532e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:42.390335 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-01d8dc1f-7f1d-4cf8-b75d-32a28fff532e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:42.396551 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-01d8dc1f-7f1d-4cf8-b75d-32a28fff532e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:42.397003 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-01d8dc1f-7f1d-4cf8-b75d-32a28fff532e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:42.397851 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-01d8dc1f-7f1d-4cf8-b75d-32a28fff532e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:42.398294 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-01d8dc1f-7f1d-4cf8-b75d-32a28fff532e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:42.426978 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-01d8dc1f-7f1d-4cf8-b75d-32a28fff532e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Going to try to terminate instance {{(pid=116227) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 09:01:42.497404 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-68da8772-1ddf-4a6d-9580-099ff113ef28 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:42.498061 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-68da8772-1ddf-4a6d-9580-099ff113ef28 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:42.504412 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-68da8772-1ddf-4a6d-9580-099ff113ef28 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:42.504937 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-68da8772-1ddf-4a6d-9580-099ff113ef28 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:42.506353 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-68da8772-1ddf-4a6d-9580-099ff113ef28 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:42.506855 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-68da8772-1ddf-4a6d-9580-099ff113ef28 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:42.511551 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-01d8dc1f-7f1d-4cf8-b75d-32a28fff532e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 204 len: 0 microversion: 2.1 time: 0.125372 Nov 23 09:01:42.512481 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 257/517] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 23 09:01:42 2021] DELETE /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 09:01:42.524773 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-765ca7da-3b59-40ad-b60d-86e531ee463a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:42.525609 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-765ca7da-3b59-40ad-b60d-86e531ee463a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:42.531987 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-765ca7da-3b59-40ad-b60d-86e531ee463a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:42.532280 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-765ca7da-3b59-40ad-b60d-86e531ee463a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:42.533324 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-765ca7da-3b59-40ad-b60d-86e531ee463a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:42.533916 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-765ca7da-3b59-40ad-b60d-86e531ee463a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:42.665411 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-68da8772-1ddf-4a6d-9580-099ff113ef28 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:42.679074 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-68da8772-1ddf-4a6d-9580-099ff113ef28 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:42.681007 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-68da8772-1ddf-4a6d-9580-099ff113ef28 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:42.682299 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-68da8772-1ddf-4a6d-9580-099ff113ef28 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1722 microversion: 2.20 time: 0.190687 Nov 23 09:01:42.683021 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 261/518] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:42 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 09:01:42.694928 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-765ca7da-3b59-40ad-b60d-86e531ee463a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:42.703478 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-765ca7da-3b59-40ad-b60d-86e531ee463a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1506 microversion: 2.1 time: 0.185913 Nov 23 09:01:42.704785 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 258/519] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:42 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1506 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:01:43.701179 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-60131ab5-c21d-4bb1-9c61-79212b3ec5c3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:43.701882 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-60131ab5-c21d-4bb1-9c61-79212b3ec5c3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:43.715362 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-60131ab5-c21d-4bb1-9c61-79212b3ec5c3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:43.715948 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-60131ab5-c21d-4bb1-9c61-79212b3ec5c3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:43.717097 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-60131ab5-c21d-4bb1-9c61-79212b3ec5c3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:43.717856 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-60131ab5-c21d-4bb1-9c61-79212b3ec5c3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:43.720214 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-c5f1668e-62b1-4538-b911-aa088b29d3d6 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:43.720824 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-c5f1668e-62b1-4538-b911-aa088b29d3d6 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:43.732092 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c5f1668e-62b1-4538-b911-aa088b29d3d6 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:43.733740 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c5f1668e-62b1-4538-b911-aa088b29d3d6 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:43.735217 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c5f1668e-62b1-4538-b911-aa088b29d3d6 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:43.735920 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c5f1668e-62b1-4538-b911-aa088b29d3d6 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:43.884241 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-60131ab5-c21d-4bb1-9c61-79212b3ec5c3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:43.893518 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-60131ab5-c21d-4bb1-9c61-79212b3ec5c3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:43.895114 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-60131ab5-c21d-4bb1-9c61-79212b3ec5c3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:43.896414 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-60131ab5-c21d-4bb1-9c61-79212b3ec5c3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1722 microversion: 2.20 time: 0.199753 Nov 23 09:01:43.897089 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 262/520] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:43 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:01:43.918991 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-c5f1668e-62b1-4538-b911-aa088b29d3d6 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:43.926326 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-c5f1668e-62b1-4538-b911-aa088b29d3d6 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1506 microversion: 2.1 time: 0.209955 Nov 23 09:01:43.926890 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 259/521] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:43 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1506 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:44.914914 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-0848cc4f-e388-45bb-a8bd-115840e20222 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:44.915523 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-0848cc4f-e388-45bb-a8bd-115840e20222 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:44.922917 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0848cc4f-e388-45bb-a8bd-115840e20222 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:44.923324 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0848cc4f-e388-45bb-a8bd-115840e20222 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:44.924107 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0848cc4f-e388-45bb-a8bd-115840e20222 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:44.924548 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0848cc4f-e388-45bb-a8bd-115840e20222 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:44.943483 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-8ca4438a-c47a-43d5-845d-1a1cb914fd52 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:44.944196 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-8ca4438a-c47a-43d5-845d-1a1cb914fd52 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:44.950753 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8ca4438a-c47a-43d5-845d-1a1cb914fd52 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:44.951214 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8ca4438a-c47a-43d5-845d-1a1cb914fd52 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:44.952000 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8ca4438a-c47a-43d5-845d-1a1cb914fd52 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:44.952441 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8ca4438a-c47a-43d5-845d-1a1cb914fd52 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:45.059787 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-0848cc4f-e388-45bb-a8bd-115840e20222 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:45.067716 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-0848cc4f-e388-45bb-a8bd-115840e20222 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:45.069229 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-0848cc4f-e388-45bb-a8bd-115840e20222 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:45.070383 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-0848cc4f-e388-45bb-a8bd-115840e20222 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1722 microversion: 2.20 time: 0.159158 Nov 23 09:01:45.070937 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 263/522] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:44 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:01:45.081928 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-8ca4438a-c47a-43d5-845d-1a1cb914fd52 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:45.089894 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-8ca4438a-c47a-43d5-845d-1a1cb914fd52 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1506 microversion: 2.1 time: 0.150287 Nov 23 09:01:45.090466 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 260/523] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:44 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:01:45.747539 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-09969290-caac-41b8-9d7f-3c9f798a1f5c req-1adf8670-2636-46f4-bc9c-bdf7a31de7f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82569d71-833c-454b-a668-12dc9a37e7e2", "name": "network-vif-unplugged", "status": "completed", "tag": "efe7e8ac-f495-4361-902c-7da559e50715"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:01:45.758094 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:01:45.758094 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 09:01:45.758094 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-09969290-caac-41b8-9d7f-3c9f798a1f5c req-1adf8670-2636-46f4-bc9c-bdf7a31de7f6 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:45.758598 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-09969290-caac-41b8-9d7f-3c9f798a1f5c req-1adf8670-2636-46f4-bc9c-bdf7a31de7f6 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:45.771995 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-09969290-caac-41b8-9d7f-3c9f798a1f5c req-1adf8670-2636-46f4-bc9c-bdf7a31de7f6 service nova] Creating event network-vif-unplugged:efe7e8ac-f495-4361-902c-7da559e50715 for instance 82569d71-833c-454b-a668-12dc9a37e7e2 on hv-cinder-76845 Nov 23 09:01:45.778585 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-09969290-caac-41b8-9d7f-3c9f798a1f5c req-1adf8670-2636-46f4-bc9c-bdf7a31de7f6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040399 Nov 23 09:01:45.780250 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 264/524] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:01:45 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:01:46.091679 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-4c26a477-2224-4d05-a347-a59336d68e01 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:46.092338 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-4c26a477-2224-4d05-a347-a59336d68e01 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:46.099343 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4c26a477-2224-4d05-a347-a59336d68e01 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:46.099343 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4c26a477-2224-4d05-a347-a59336d68e01 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:46.100084 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4c26a477-2224-4d05-a347-a59336d68e01 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:46.100525 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4c26a477-2224-4d05-a347-a59336d68e01 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:46.107715 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8434dfa2-b757-4a25-b486-41fd08108cad tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:46.109718 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-8434dfa2-b757-4a25-b486-41fd08108cad tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:46.116803 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8434dfa2-b757-4a25-b486-41fd08108cad tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:46.117558 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8434dfa2-b757-4a25-b486-41fd08108cad tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:46.118571 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8434dfa2-b757-4a25-b486-41fd08108cad tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:46.119203 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8434dfa2-b757-4a25-b486-41fd08108cad tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:46.235882 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-4c26a477-2224-4d05-a347-a59336d68e01 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:46.253960 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-4c26a477-2224-4d05-a347-a59336d68e01 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:46.255968 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-4c26a477-2224-4d05-a347-a59336d68e01 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:46.257334 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-4c26a477-2224-4d05-a347-a59336d68e01 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1722 microversion: 2.20 time: 0.169593 Nov 23 09:01:46.258050 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 261/525] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:46 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 09:01:46.362125 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-8434dfa2-b757-4a25-b486-41fd08108cad tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:46.369552 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-8434dfa2-b757-4a25-b486-41fd08108cad tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1506 microversion: 2.1 time: 0.266170 Nov 23 09:01:46.370116 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 265/526] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:46 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1506 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:01:47.277351 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-b939f6b9-22b0-4a01-9a70-b9309442bbc9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:47.278973 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-b939f6b9-22b0-4a01-9a70-b9309442bbc9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:47.285688 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b939f6b9-22b0-4a01-9a70-b9309442bbc9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:47.286136 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b939f6b9-22b0-4a01-9a70-b9309442bbc9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:47.286915 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b939f6b9-22b0-4a01-9a70-b9309442bbc9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:47.287347 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b939f6b9-22b0-4a01-9a70-b9309442bbc9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:47.387296 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b550064a-798e-4ae3-883c-777752700337 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:47.387911 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b550064a-798e-4ae3-883c-777752700337 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:47.394121 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b550064a-798e-4ae3-883c-777752700337 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:47.394557 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b550064a-798e-4ae3-883c-777752700337 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:47.395384 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b550064a-798e-4ae3-883c-777752700337 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:47.395824 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b550064a-798e-4ae3-883c-777752700337 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:47.428528 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-b939f6b9-22b0-4a01-9a70-b9309442bbc9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:47.444405 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-b939f6b9-22b0-4a01-9a70-b9309442bbc9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:47.448370 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-b939f6b9-22b0-4a01-9a70-b9309442bbc9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:47.450726 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-b939f6b9-22b0-4a01-9a70-b9309442bbc9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1665 microversion: 2.20 time: 0.178310 Nov 23 09:01:47.451840 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 262/527] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:47 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1665 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:01:47.470589 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-a48e20ed-3d0a-4464-8845-ff748e04e668 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "370ca257-a63c-450c-8a3f-7b7e7b601d49"}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:01:47.471787 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-a48e20ed-3d0a-4464-8845-ff748e04e668 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:47.478182 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a48e20ed-3d0a-4464-8845-ff748e04e668 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:47.478734 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a48e20ed-3d0a-4464-8845-ff748e04e668 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:47.479597 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a48e20ed-3d0a-4464-8845-ff748e04e668 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:47.480907 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a48e20ed-3d0a-4464-8845-ff748e04e668 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:47.548883 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b550064a-798e-4ae3-883c-777752700337 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:47.557451 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b550064a-798e-4ae3-883c-777752700337 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1506 microversion: 2.1 time: 0.174492 Nov 23 09:01:47.558192 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 266/528] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:47 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1506 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:47.765759 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-a48e20ed-3d0a-4464-8845-ff748e04e668 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.300660 Nov 23 09:01:47.766368 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 263/529] 10.222.0.46 () {62 vars in 1363 bytes} [Tue Nov 23 09:01:47 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/os-volume_attachments => generated 188 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 09:01:47.879361 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-3dcb3f50-69ff-4cd3-99b2-a771c4557104 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:01:47.879930 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-3dcb3f50-69ff-4cd3-99b2-a771c4557104 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:47.887244 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3dcb3f50-69ff-4cd3-99b2-a771c4557104 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:47.887697 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3dcb3f50-69ff-4cd3-99b2-a771c4557104 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:47.888474 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3dcb3f50-69ff-4cd3-99b2-a771c4557104 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:47.888910 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3dcb3f50-69ff-4cd3-99b2-a771c4557104 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:47.988499 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-3dcb3f50-69ff-4cd3-99b2-a771c4557104 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action" status: 202 len: 0 microversion: 2.20 time: 0.112474 Nov 23 09:01:47.989318 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 267/530] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:01:47 2021] POST /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 23 09:01:48.001499 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-6aff3200-6fdd-40d5-be59-bd33b1687f2a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:48.002130 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-6aff3200-6fdd-40d5-be59-bd33b1687f2a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:48.009419 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6aff3200-6fdd-40d5-be59-bd33b1687f2a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:48.009871 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6aff3200-6fdd-40d5-be59-bd33b1687f2a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:48.011331 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6aff3200-6fdd-40d5-be59-bd33b1687f2a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:48.011770 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6aff3200-6fdd-40d5-be59-bd33b1687f2a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:48.154678 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-6aff3200-6fdd-40d5-be59-bd33b1687f2a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:48.162955 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-6aff3200-6fdd-40d5-be59-bd33b1687f2a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:48.164439 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-6aff3200-6fdd-40d5-be59-bd33b1687f2a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:48.166142 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-6aff3200-6fdd-40d5-be59-bd33b1687f2a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1751 microversion: 2.20 time: 0.172371 Nov 23 09:01:48.167516 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 264/531] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:47 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1751 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:01:48.575708 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b29409fe-665f-4ee8-b839-1fae8ffeac6d tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:48.576352 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b29409fe-665f-4ee8-b839-1fae8ffeac6d tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:48.584665 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b29409fe-665f-4ee8-b839-1fae8ffeac6d tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:48.585121 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b29409fe-665f-4ee8-b839-1fae8ffeac6d tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:48.586170 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b29409fe-665f-4ee8-b839-1fae8ffeac6d tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:48.586637 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b29409fe-665f-4ee8-b839-1fae8ffeac6d tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:48.891949 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b29409fe-665f-4ee8-b839-1fae8ffeac6d tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:48.899512 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b29409fe-665f-4ee8-b839-1fae8ffeac6d tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1506 microversion: 2.1 time: 0.328662 Nov 23 09:01:48.900096 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 268/532] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:48 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1506 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:49.184984 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-18da299d-6945-4aa1-8dc2-89f9baaaedaf tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:49.186244 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-18da299d-6945-4aa1-8dc2-89f9baaaedaf tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:49.195079 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-18da299d-6945-4aa1-8dc2-89f9baaaedaf tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:49.198189 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-18da299d-6945-4aa1-8dc2-89f9baaaedaf tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:49.199174 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-18da299d-6945-4aa1-8dc2-89f9baaaedaf tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:49.199498 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-18da299d-6945-4aa1-8dc2-89f9baaaedaf tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:49.382433 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-18da299d-6945-4aa1-8dc2-89f9baaaedaf tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:49.397705 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-18da299d-6945-4aa1-8dc2-89f9baaaedaf tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:49.399548 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-18da299d-6945-4aa1-8dc2-89f9baaaedaf tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:49.402259 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-18da299d-6945-4aa1-8dc2-89f9baaaedaf tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1753 microversion: 2.20 time: 0.220975 Nov 23 09:01:49.403549 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 265/533] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:49 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1753 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:01:49.435455 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-79297bf7-4053-4c3c-b477-cd37545531d2 req-bee953b7-be1f-4980-b33f-517b4802aee4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7360d955-d8b0-49dc-bb7e-a804b8f5246b", "name": "network-vif-deleted", "tag": "14b8cc4b-9be8-4f3d-9cd6-e402ed0c9704"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:01:49.437345 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:01:49.437345 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 09:01:49.449450 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-79297bf7-4053-4c3c-b477-cd37545531d2 req-bee953b7-be1f-4980-b33f-517b4802aee4 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:49.450166 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-79297bf7-4053-4c3c-b477-cd37545531d2 req-bee953b7-be1f-4980-b33f-517b4802aee4 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:49.462573 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-79297bf7-4053-4c3c-b477-cd37545531d2 req-bee953b7-be1f-4980-b33f-517b4802aee4 service nova] Creating event network-vif-deleted:14b8cc4b-9be8-4f3d-9cd6-e402ed0c9704 for instance 7360d955-d8b0-49dc-bb7e-a804b8f5246b on hv-cinder-76845 Nov 23 09:01:49.468828 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-79297bf7-4053-4c3c-b477-cd37545531d2 req-bee953b7-be1f-4980-b33f-517b4802aee4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038646 Nov 23 09:01:49.473321 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 269/534] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:01:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:01:49.918199 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-a7b72ef9-878d-44cc-84c2-78806b1753b8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:49.919193 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-a7b72ef9-878d-44cc-84c2-78806b1753b8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:49.925248 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a7b72ef9-878d-44cc-84c2-78806b1753b8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:49.925778 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a7b72ef9-878d-44cc-84c2-78806b1753b8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:49.926635 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a7b72ef9-878d-44cc-84c2-78806b1753b8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:49.927138 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a7b72ef9-878d-44cc-84c2-78806b1753b8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:49.962159 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a7b72ef9-878d-44cc-84c2-78806b1753b8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:49.962991 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a7b72ef9-878d-44cc-84c2-78806b1753b8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:49.963269 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.objects.instance [None req-a7b72ef9-878d-44cc-84c2-78806b1753b8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lazy-loading 'fault' on Instance uuid 7360d955-d8b0-49dc-bb7e-a804b8f5246b {{(pid=116227) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 09:01:50.023933 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-a7b72ef9-878d-44cc-84c2-78806b1753b8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:50.035719 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-a7b72ef9-878d-44cc-84c2-78806b1753b8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 200 len: 1311 microversion: 2.1 time: 0.121686 Nov 23 09:01:50.036813 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 266/535] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:49 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 1311 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:50.235814 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-ead4ebd3-7eeb-436e-aae9-74d356d4c60c tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:50.236396 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-ead4ebd3-7eeb-436e-aae9-74d356d4c60c tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: d24b89a9-3395-4744-8c8c-7cb14a68dae6] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:50.242620 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ead4ebd3-7eeb-436e-aae9-74d356d4c60c tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:50.243153 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ead4ebd3-7eeb-436e-aae9-74d356d4c60c tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:50.244013 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ead4ebd3-7eeb-436e-aae9-74d356d4c60c tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:50.244555 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ead4ebd3-7eeb-436e-aae9-74d356d4c60c tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:50.329104 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.objects.instance [None req-ead4ebd3-7eeb-436e-aae9-74d356d4c60c tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lazy-loading 'services' on Instance uuid d24b89a9-3395-4744-8c8c-7cb14a68dae6 {{(pid=116226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 09:01:50.405006 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-ead4ebd3-7eeb-436e-aae9-74d356d4c60c tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6/os-volume_attachments/7b5795da-a5ff-4bf8-909d-4b8ddf12848d" status: 202 len: 0 microversion: 2.1 time: 0.173842 Nov 23 09:01:50.405764 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 270/536] 10.222.0.46 () {58 vars in 1415 bytes} [Tue Nov 23 09:01:50 2021] DELETE /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6/os-volume_attachments/7b5795da-a5ff-4bf8-909d-4b8ddf12848d => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:01:50.423505 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-5ca62086-a939-4732-9068-960bb4c18a72 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:50.424117 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-5ca62086-a939-4732-9068-960bb4c18a72 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:50.437322 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5ca62086-a939-4732-9068-960bb4c18a72 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:50.438370 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5ca62086-a939-4732-9068-960bb4c18a72 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:50.441725 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5ca62086-a939-4732-9068-960bb4c18a72 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:50.442329 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5ca62086-a939-4732-9068-960bb4c18a72 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:50.633398 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-5ca62086-a939-4732-9068-960bb4c18a72 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:50.642818 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-5ca62086-a939-4732-9068-960bb4c18a72 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:50.644251 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-5ca62086-a939-4732-9068-960bb4c18a72 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:50.645562 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-5ca62086-a939-4732-9068-960bb4c18a72 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1809 microversion: 2.20 time: 0.226505 Nov 23 09:01:50.646316 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 267/537] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:50 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1809 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:01:51.059887 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-813fb5a9-1acf-46cc-b741-23e9d1a4f864 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:51.060592 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-813fb5a9-1acf-46cc-b741-23e9d1a4f864 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 7360d955-d8b0-49dc-bb7e-a804b8f5246b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:51.066987 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-813fb5a9-1acf-46cc-b741-23e9d1a4f864 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:51.067634 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-813fb5a9-1acf-46cc-b741-23e9d1a4f864 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:51.068404 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-813fb5a9-1acf-46cc-b741-23e9d1a4f864 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:51.069307 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-813fb5a9-1acf-46cc-b741-23e9d1a4f864 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:51.083355 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-813fb5a9-1acf-46cc-b741-23e9d1a4f864 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] HTTP exception thrown: Instance 7360d955-d8b0-49dc-bb7e-a804b8f5246b could not be found. Nov 23 09:01:51.083943 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-813fb5a9-1acf-46cc-b741-23e9d1a4f864 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Returning 404 to user: Instance 7360d955-d8b0-49dc-bb7e-a804b8f5246b could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 09:01:51.084762 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-813fb5a9-1acf-46cc-b741-23e9d1a4f864 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b" status: 404 len: 111 microversion: 2.1 time: 0.029069 Nov 23 09:01:51.085335 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 271/538] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:51 2021] GET /compute/v2.1/servers/7360d955-d8b0-49dc-bb7e-a804b8f5246b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 23 09:01:51.094743 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-75b81f64-802f-411f-8add-d9877aa645f7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:51.095233 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-75b81f64-802f-411f-8add-d9877aa645f7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:51.101622 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-75b81f64-802f-411f-8add-d9877aa645f7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:51.102076 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-75b81f64-802f-411f-8add-d9877aa645f7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:51.102862 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-75b81f64-802f-411f-8add-d9877aa645f7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:51.103300 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-75b81f64-802f-411f-8add-d9877aa645f7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:51.137543 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-75b81f64-802f-411f-8add-d9877aa645f7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Going to try to terminate instance {{(pid=116227) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 09:01:51.286062 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-75b81f64-802f-411f-8add-d9877aa645f7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 204 len: 0 microversion: 2.1 time: 0.193156 Nov 23 09:01:51.287815 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 268/539] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 23 09:01:51 2021] DELETE /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 09:01:51.296947 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d17e9941-3c50-47b6-af61-77b57a4be7fe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:51.298413 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d17e9941-3c50-47b6-af61-77b57a4be7fe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:51.305471 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d17e9941-3c50-47b6-af61-77b57a4be7fe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:51.306250 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d17e9941-3c50-47b6-af61-77b57a4be7fe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:51.308023 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d17e9941-3c50-47b6-af61-77b57a4be7fe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:51.308660 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d17e9941-3c50-47b6-af61-77b57a4be7fe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:51.450781 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d17e9941-3c50-47b6-af61-77b57a4be7fe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:51.458212 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d17e9941-3c50-47b6-af61-77b57a4be7fe tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1520 microversion: 2.1 time: 0.165292 Nov 23 09:01:51.458781 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 272/540] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:51 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:51.532592 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-37a90bed-b33c-4754-baba-3d72c1a189d6 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:51.533222 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-37a90bed-b33c-4754-baba-3d72c1a189d6 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: d24b89a9-3395-4744-8c8c-7cb14a68dae6] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:51.540021 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-37a90bed-b33c-4754-baba-3d72c1a189d6 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:51.540477 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-37a90bed-b33c-4754-baba-3d72c1a189d6 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:51.541375 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-37a90bed-b33c-4754-baba-3d72c1a189d6 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:51.541988 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-37a90bed-b33c-4754-baba-3d72c1a189d6 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:51.573389 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-37a90bed-b33c-4754-baba-3d72c1a189d6 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: d24b89a9-3395-4744-8c8c-7cb14a68dae6] Going to try to terminate instance {{(pid=116227) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 09:01:51.666957 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-9c4cc75f-4137-4e25-b4d0-5b2e1533d96b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:51.667727 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-9c4cc75f-4137-4e25-b4d0-5b2e1533d96b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:51.677224 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9c4cc75f-4137-4e25-b4d0-5b2e1533d96b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:51.679163 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9c4cc75f-4137-4e25-b4d0-5b2e1533d96b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:51.680063 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9c4cc75f-4137-4e25-b4d0-5b2e1533d96b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:51.682903 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9c4cc75f-4137-4e25-b4d0-5b2e1533d96b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:51.684446 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-37a90bed-b33c-4754-baba-3d72c1a189d6 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6" status: 204 len: 0 microversion: 2.1 time: 0.155744 Nov 23 09:01:51.685038 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 269/541] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 23 09:01:51 2021] DELETE /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 09:01:51.700031 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-edb6c867-c34b-4cc4-8b36-0423e3672b45 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:51.700840 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-edb6c867-c34b-4cc4-8b36-0423e3672b45 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: d24b89a9-3395-4744-8c8c-7cb14a68dae6] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:51.711303 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-edb6c867-c34b-4cc4-8b36-0423e3672b45 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:51.712009 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-edb6c867-c34b-4cc4-8b36-0423e3672b45 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:51.714082 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-edb6c867-c34b-4cc4-8b36-0423e3672b45 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:51.715051 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-edb6c867-c34b-4cc4-8b36-0423e3672b45 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:51.882993 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-9c4cc75f-4137-4e25-b4d0-5b2e1533d96b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:51.902139 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-9c4cc75f-4137-4e25-b4d0-5b2e1533d96b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:51.904092 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-9c4cc75f-4137-4e25-b4d0-5b2e1533d96b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:51.906066 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-9c4cc75f-4137-4e25-b4d0-5b2e1533d96b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1809 microversion: 2.20 time: 0.245563 Nov 23 09:01:51.906856 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 273/542] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:51 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1809 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 09:01:51.912724 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-edb6c867-c34b-4cc4-8b36-0423e3672b45 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:51.920905 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-edb6c867-c34b-4cc4-8b36-0423e3672b45 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6" status: 200 len: 1513 microversion: 2.1 time: 0.230464 Nov 23 09:01:51.921621 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 270/543] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:51 2021] GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6 => generated 1513 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:52.476195 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-082bf6a0-6d99-4f08-8bb3-3668d83364a7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:52.476854 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-082bf6a0-6d99-4f08-8bb3-3668d83364a7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:52.484232 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-082bf6a0-6d99-4f08-8bb3-3668d83364a7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:52.484841 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-082bf6a0-6d99-4f08-8bb3-3668d83364a7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:52.485874 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-082bf6a0-6d99-4f08-8bb3-3668d83364a7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:52.486315 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-082bf6a0-6d99-4f08-8bb3-3668d83364a7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:52.632745 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-082bf6a0-6d99-4f08-8bb3-3668d83364a7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:52.641763 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-082bf6a0-6d99-4f08-8bb3-3668d83364a7 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1520 microversion: 2.1 time: 0.169524 Nov 23 09:01:52.645584 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 274/544] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:52 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:52.926175 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-08415399-1c29-4aab-bb53-9c8283568cb6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:52.927847 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-08415399-1c29-4aab-bb53-9c8283568cb6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:52.943386 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-de82ae51-b3e9-436e-ba49-8cd2b498a824 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:52.943386 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-de82ae51-b3e9-436e-ba49-8cd2b498a824 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: d24b89a9-3395-4744-8c8c-7cb14a68dae6] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:52.943702 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-08415399-1c29-4aab-bb53-9c8283568cb6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:52.943702 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-08415399-1c29-4aab-bb53-9c8283568cb6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:52.943864 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-08415399-1c29-4aab-bb53-9c8283568cb6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:52.945811 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-08415399-1c29-4aab-bb53-9c8283568cb6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:52.945909 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-de82ae51-b3e9-436e-ba49-8cd2b498a824 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:52.946073 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-de82ae51-b3e9-436e-ba49-8cd2b498a824 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:52.947060 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-de82ae51-b3e9-436e-ba49-8cd2b498a824 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:52.948534 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-de82ae51-b3e9-436e-ba49-8cd2b498a824 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:53.094977 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-08415399-1c29-4aab-bb53-9c8283568cb6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:53.104271 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-08415399-1c29-4aab-bb53-9c8283568cb6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:53.105533 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-de82ae51-b3e9-436e-ba49-8cd2b498a824 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:53.108801 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-08415399-1c29-4aab-bb53-9c8283568cb6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:53.110727 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-08415399-1c29-4aab-bb53-9c8283568cb6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1809 microversion: 2.20 time: 0.188936 Nov 23 09:01:53.115844 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 271/545] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:52 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 09:01:53.120242 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-de82ae51-b3e9-436e-ba49-8cd2b498a824 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6" status: 200 len: 1513 microversion: 2.1 time: 0.184981 Nov 23 09:01:53.121007 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 275/546] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:52 2021] GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6 => generated 1513 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:53.659358 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-220d4972-c819-43ef-9a60-ea32200f6291 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:53.659994 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-220d4972-c819-43ef-9a60-ea32200f6291 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:53.665879 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-220d4972-c819-43ef-9a60-ea32200f6291 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:53.666846 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-220d4972-c819-43ef-9a60-ea32200f6291 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:53.667628 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-220d4972-c819-43ef-9a60-ea32200f6291 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:53.668065 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-220d4972-c819-43ef-9a60-ea32200f6291 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:53.800550 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-220d4972-c819-43ef-9a60-ea32200f6291 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:53.810157 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-220d4972-c819-43ef-9a60-ea32200f6291 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1520 microversion: 2.1 time: 0.154342 Nov 23 09:01:53.811678 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 272/547] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:53 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:54.129805 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-ae61ff17-8fec-4332-9428-4599496767a9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:54.130440 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-ae61ff17-8fec-4332-9428-4599496767a9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:54.137949 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-b0ea4670-f376-434e-907c-ebedfa80c243 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:54.138583 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ae61ff17-8fec-4332-9428-4599496767a9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:54.138706 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-b0ea4670-f376-434e-907c-ebedfa80c243 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: d24b89a9-3395-4744-8c8c-7cb14a68dae6] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:54.139034 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ae61ff17-8fec-4332-9428-4599496767a9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:54.139850 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ae61ff17-8fec-4332-9428-4599496767a9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:54.140284 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ae61ff17-8fec-4332-9428-4599496767a9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:54.144779 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b0ea4670-f376-434e-907c-ebedfa80c243 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:54.145311 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b0ea4670-f376-434e-907c-ebedfa80c243 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:54.146097 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b0ea4670-f376-434e-907c-ebedfa80c243 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:54.146528 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b0ea4670-f376-434e-907c-ebedfa80c243 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:54.302069 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-ae61ff17-8fec-4332-9428-4599496767a9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:54.310711 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-ae61ff17-8fec-4332-9428-4599496767a9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:54.312216 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-ae61ff17-8fec-4332-9428-4599496767a9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:54.313409 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-ae61ff17-8fec-4332-9428-4599496767a9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1809 microversion: 2.20 time: 0.187335 Nov 23 09:01:54.313974 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 276/548] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:54 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1809 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:01:54.314774 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-b0ea4670-f376-434e-907c-ebedfa80c243 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:54.323462 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-b0ea4670-f376-434e-907c-ebedfa80c243 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6" status: 200 len: 1513 microversion: 2.1 time: 0.189433 Nov 23 09:01:54.324114 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 273/549] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:54 2021] GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6 => generated 1513 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:54.835008 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-3094a30d-9c8d-4d60-a698-5f807e192481 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:54.836275 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-3094a30d-9c8d-4d60-a698-5f807e192481 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:54.845132 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3094a30d-9c8d-4d60-a698-5f807e192481 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:54.845762 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3094a30d-9c8d-4d60-a698-5f807e192481 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:54.846690 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3094a30d-9c8d-4d60-a698-5f807e192481 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:54.847294 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3094a30d-9c8d-4d60-a698-5f807e192481 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:54.985146 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-3094a30d-9c8d-4d60-a698-5f807e192481 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:54.992997 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-3094a30d-9c8d-4d60-a698-5f807e192481 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1520 microversion: 2.1 time: 0.167232 Nov 23 09:01:54.993774 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 277/550] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:54 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:55.332296 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-09a88687-a427-41fd-89f9-8e2cfeec1b8d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:55.332954 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-09a88687-a427-41fd-89f9-8e2cfeec1b8d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:55.340521 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f6832e98-b3d7-4b2e-9c59-f0b163d391c9 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:55.341486 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f6832e98-b3d7-4b2e-9c59-f0b163d391c9 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: d24b89a9-3395-4744-8c8c-7cb14a68dae6] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:55.347017 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-09a88687-a427-41fd-89f9-8e2cfeec1b8d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:55.348061 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-09a88687-a427-41fd-89f9-8e2cfeec1b8d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:55.349261 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-09a88687-a427-41fd-89f9-8e2cfeec1b8d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:55.350035 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-09a88687-a427-41fd-89f9-8e2cfeec1b8d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:55.351383 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f6832e98-b3d7-4b2e-9c59-f0b163d391c9 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:55.351840 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f6832e98-b3d7-4b2e-9c59-f0b163d391c9 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:55.352692 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f6832e98-b3d7-4b2e-9c59-f0b163d391c9 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:55.353136 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f6832e98-b3d7-4b2e-9c59-f0b163d391c9 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:55.515192 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-09a88687-a427-41fd-89f9-8e2cfeec1b8d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:55.523376 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-f6832e98-b3d7-4b2e-9c59-f0b163d391c9 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:55.523557 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-09a88687-a427-41fd-89f9-8e2cfeec1b8d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:55.525007 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-09a88687-a427-41fd-89f9-8e2cfeec1b8d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:55.527095 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-09a88687-a427-41fd-89f9-8e2cfeec1b8d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1809 microversion: 2.20 time: 0.198828 Nov 23 09:01:55.527674 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 274/551] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:55 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1809 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:01:55.532690 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f6832e98-b3d7-4b2e-9c59-f0b163d391c9 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6" status: 200 len: 1513 microversion: 2.1 time: 0.195609 Nov 23 09:01:55.533454 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 278/552] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:55 2021] GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6 => generated 1513 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:56.010578 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-06170e02-8317-44e4-ad0a-f5ce829ca31e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:56.011371 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-06170e02-8317-44e4-ad0a-f5ce829ca31e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:56.017933 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-06170e02-8317-44e4-ad0a-f5ce829ca31e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:56.018429 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-06170e02-8317-44e4-ad0a-f5ce829ca31e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:56.019509 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-06170e02-8317-44e4-ad0a-f5ce829ca31e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:56.019976 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-06170e02-8317-44e4-ad0a-f5ce829ca31e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:56.202758 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-06170e02-8317-44e4-ad0a-f5ce829ca31e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:56.210202 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-06170e02-8317-44e4-ad0a-f5ce829ca31e tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1520 microversion: 2.1 time: 0.204074 Nov 23 09:01:56.210778 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 275/553] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:56 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:56.546879 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-47432470-020e-407c-9e74-a4f743f5b301 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:56.547523 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-47432470-020e-407c-9e74-a4f743f5b301 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:56.553149 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-279ad253-b3fc-44e3-930d-b751f2f8a349 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:56.554218 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-47432470-020e-407c-9e74-a4f743f5b301 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:56.554583 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-279ad253-b3fc-44e3-930d-b751f2f8a349 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: d24b89a9-3395-4744-8c8c-7cb14a68dae6] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:56.554826 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-47432470-020e-407c-9e74-a4f743f5b301 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:56.561622 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-47432470-020e-407c-9e74-a4f743f5b301 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:56.562846 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-279ad253-b3fc-44e3-930d-b751f2f8a349 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:56.563473 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-47432470-020e-407c-9e74-a4f743f5b301 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:56.563705 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-279ad253-b3fc-44e3-930d-b751f2f8a349 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:56.564653 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-279ad253-b3fc-44e3-930d-b751f2f8a349 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:56.565568 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-279ad253-b3fc-44e3-930d-b751f2f8a349 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:56.716437 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-279ad253-b3fc-44e3-930d-b751f2f8a349 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:56.725156 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-279ad253-b3fc-44e3-930d-b751f2f8a349 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6" status: 200 len: 1513 microversion: 2.1 time: 0.175889 Nov 23 09:01:56.725763 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 276/554] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:56 2021] GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6 => generated 1513 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:56.737083 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-47432470-020e-407c-9e74-a4f743f5b301 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:56.746367 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-47432470-020e-407c-9e74-a4f743f5b301 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:56.747845 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-47432470-020e-407c-9e74-a4f743f5b301 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:56.749006 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-47432470-020e-407c-9e74-a4f743f5b301 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1809 microversion: 2.20 time: 0.206219 Nov 23 09:01:56.749615 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 279/555] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:56 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1809 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 09:01:57.227935 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-62be5d17-ed53-4c14-b747-0ad09deb0f0a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:57.229112 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-62be5d17-ed53-4c14-b747-0ad09deb0f0a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:57.235651 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-62be5d17-ed53-4c14-b747-0ad09deb0f0a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:57.236110 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-62be5d17-ed53-4c14-b747-0ad09deb0f0a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:57.236912 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-62be5d17-ed53-4c14-b747-0ad09deb0f0a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:57.237384 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-62be5d17-ed53-4c14-b747-0ad09deb0f0a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:57.376470 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-62be5d17-ed53-4c14-b747-0ad09deb0f0a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:57.385191 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-62be5d17-ed53-4c14-b747-0ad09deb0f0a tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1520 microversion: 2.1 time: 0.160924 Nov 23 09:01:57.385961 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 277/556] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:57 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:57.741975 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-9e729b06-2669-4978-b92d-64a284adfbdd tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:57.742547 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-9e729b06-2669-4978-b92d-64a284adfbdd tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: d24b89a9-3395-4744-8c8c-7cb14a68dae6] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:57.748816 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9e729b06-2669-4978-b92d-64a284adfbdd tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:57.749298 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9e729b06-2669-4978-b92d-64a284adfbdd tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:57.750186 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9e729b06-2669-4978-b92d-64a284adfbdd tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:57.750653 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9e729b06-2669-4978-b92d-64a284adfbdd tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:57.767420 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-a9994173-8d80-4a6d-8fad-542d22543549 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:57.768108 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-a9994173-8d80-4a6d-8fad-542d22543549 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:57.774964 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a9994173-8d80-4a6d-8fad-542d22543549 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:57.775652 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a9994173-8d80-4a6d-8fad-542d22543549 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:57.776549 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a9994173-8d80-4a6d-8fad-542d22543549 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:57.777075 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a9994173-8d80-4a6d-8fad-542d22543549 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:57.898686 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-9e729b06-2669-4978-b92d-64a284adfbdd tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:57.906722 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-9e729b06-2669-4978-b92d-64a284adfbdd tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6" status: 200 len: 1513 microversion: 2.1 time: 0.168462 Nov 23 09:01:57.907295 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 280/557] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:57 2021] GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6 => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:57.942948 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-a9994173-8d80-4a6d-8fad-542d22543549 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:57.952899 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-a9994173-8d80-4a6d-8fad-542d22543549 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:57.954426 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-a9994173-8d80-4a6d-8fad-542d22543549 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:57.955678 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-a9994173-8d80-4a6d-8fad-542d22543549 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1809 microversion: 2.20 time: 0.192183 Nov 23 09:01:57.956236 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 278/558] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:57 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 09:01:58.403622 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-7d7724fe-4284-4c91-a2ac-ca918c546917 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:58.404193 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-7d7724fe-4284-4c91-a2ac-ca918c546917 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:58.411022 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7d7724fe-4284-4c91-a2ac-ca918c546917 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:58.411475 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7d7724fe-4284-4c91-a2ac-ca918c546917 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:58.412257 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7d7724fe-4284-4c91-a2ac-ca918c546917 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:58.412690 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7d7724fe-4284-4c91-a2ac-ca918c546917 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:58.566018 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-7d7724fe-4284-4c91-a2ac-ca918c546917 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:58.574371 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-7d7724fe-4284-4c91-a2ac-ca918c546917 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1520 microversion: 2.1 time: 0.175493 Nov 23 09:01:58.574958 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 281/559] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:58 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:58.923941 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-3a44a201-8a6b-49f0-8d32-6b62b23b5cec tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:58.925301 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-3a44a201-8a6b-49f0-8d32-6b62b23b5cec tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: d24b89a9-3395-4744-8c8c-7cb14a68dae6] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:58.931752 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3a44a201-8a6b-49f0-8d32-6b62b23b5cec tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:58.932195 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3a44a201-8a6b-49f0-8d32-6b62b23b5cec tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:58.932992 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3a44a201-8a6b-49f0-8d32-6b62b23b5cec tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:58.933507 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3a44a201-8a6b-49f0-8d32-6b62b23b5cec tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:58.974775 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-37ec14c0-de98-49f1-84d6-d861b26742d6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:58.975460 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-37ec14c0-de98-49f1-84d6-d861b26742d6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:58.983542 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-37ec14c0-de98-49f1-84d6-d861b26742d6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:58.984035 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-37ec14c0-de98-49f1-84d6-d861b26742d6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:58.985117 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-37ec14c0-de98-49f1-84d6-d861b26742d6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:58.985793 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-37ec14c0-de98-49f1-84d6-d861b26742d6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:59.108875 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-3a44a201-8a6b-49f0-8d32-6b62b23b5cec tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:59.116503 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-3a44a201-8a6b-49f0-8d32-6b62b23b5cec tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6" status: 200 len: 1513 microversion: 2.1 time: 0.196305 Nov 23 09:01:59.117302 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 279/560] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:58 2021] GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6 => generated 1513 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:01:59.140429 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-37ec14c0-de98-49f1-84d6-d861b26742d6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:59.149301 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-37ec14c0-de98-49f1-84d6-d861b26742d6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:59.151388 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-37ec14c0-de98-49f1-84d6-d861b26742d6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:59.152593 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-37ec14c0-de98-49f1-84d6-d861b26742d6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1809 microversion: 2.20 time: 0.181732 Nov 23 09:01:59.153515 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 282/561] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:01:58 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 09:01:59.592384 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-3f745879-9a18-4dc0-a5ef-cf00fa8e2cb9 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:01:59.592981 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-3f745879-9a18-4dc0-a5ef-cf00fa8e2cb9 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:01:59.599002 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3f745879-9a18-4dc0-a5ef-cf00fa8e2cb9 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:59.599456 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3f745879-9a18-4dc0-a5ef-cf00fa8e2cb9 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:59.600229 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3f745879-9a18-4dc0-a5ef-cf00fa8e2cb9 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:01:59.600665 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3f745879-9a18-4dc0-a5ef-cf00fa8e2cb9 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:01:59.769106 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-3f745879-9a18-4dc0-a5ef-cf00fa8e2cb9 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:01:59.777083 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-3f745879-9a18-4dc0-a5ef-cf00fa8e2cb9 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1520 microversion: 2.1 time: 0.189521 Nov 23 09:01:59.777670 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 280/562] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:01:59 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:00.134506 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-befe5add-b466-430e-a65b-c0e8e2258aae tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:00.135564 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-befe5add-b466-430e-a65b-c0e8e2258aae tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: d24b89a9-3395-4744-8c8c-7cb14a68dae6] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:00.142434 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-befe5add-b466-430e-a65b-c0e8e2258aae tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:00.142911 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-befe5add-b466-430e-a65b-c0e8e2258aae tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:00.143771 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-befe5add-b466-430e-a65b-c0e8e2258aae tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:00.144166 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-befe5add-b466-430e-a65b-c0e8e2258aae tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:00.171490 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-2abb3c20-6669-4b68-98a7-9b09b367b98d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:00.172136 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-2abb3c20-6669-4b68-98a7-9b09b367b98d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:00.178736 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2abb3c20-6669-4b68-98a7-9b09b367b98d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:00.179188 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2abb3c20-6669-4b68-98a7-9b09b367b98d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:00.179970 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2abb3c20-6669-4b68-98a7-9b09b367b98d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:00.180399 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2abb3c20-6669-4b68-98a7-9b09b367b98d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:00.291474 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-befe5add-b466-430e-a65b-c0e8e2258aae tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:00.299412 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-befe5add-b466-430e-a65b-c0e8e2258aae tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6" status: 200 len: 1513 microversion: 2.1 time: 0.168601 Nov 23 09:02:00.300351 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 283/563] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:00 2021] GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6 => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:00.327378 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-2abb3c20-6669-4b68-98a7-9b09b367b98d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:00.336056 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-2abb3c20-6669-4b68-98a7-9b09b367b98d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:00.337671 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-2abb3c20-6669-4b68-98a7-9b09b367b98d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:00.339288 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-2abb3c20-6669-4b68-98a7-9b09b367b98d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1809 microversion: 2.20 time: 0.172126 Nov 23 09:02:00.339863 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 281/564] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:02:00 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:02:00.794111 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-09cde5f6-b975-4b5c-a00b-e38e9bb6cff1 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:00.794826 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-09cde5f6-b975-4b5c-a00b-e38e9bb6cff1 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:00.800947 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-09cde5f6-b975-4b5c-a00b-e38e9bb6cff1 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:00.801447 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-09cde5f6-b975-4b5c-a00b-e38e9bb6cff1 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:00.802263 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-09cde5f6-b975-4b5c-a00b-e38e9bb6cff1 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:00.802737 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-09cde5f6-b975-4b5c-a00b-e38e9bb6cff1 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:00.959589 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-09cde5f6-b975-4b5c-a00b-e38e9bb6cff1 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:00.970972 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-09cde5f6-b975-4b5c-a00b-e38e9bb6cff1 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1520 microversion: 2.1 time: 0.180537 Nov 23 09:02:00.971598 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 284/565] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:00 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:01.317686 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-c42c4c14-139a-4398-a1ba-cde6febb9663 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:01.318280 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-c42c4c14-139a-4398-a1ba-cde6febb9663 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: d24b89a9-3395-4744-8c8c-7cb14a68dae6] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:01.326071 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c42c4c14-139a-4398-a1ba-cde6febb9663 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:01.326852 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c42c4c14-139a-4398-a1ba-cde6febb9663 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:01.328057 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c42c4c14-139a-4398-a1ba-cde6febb9663 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:01.328586 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c42c4c14-139a-4398-a1ba-cde6febb9663 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:01.357349 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a231bf66-cafc-4127-98de-f5ecdae8a3c3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:01.358595 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a231bf66-cafc-4127-98de-f5ecdae8a3c3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:01.373246 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a231bf66-cafc-4127-98de-f5ecdae8a3c3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:01.373740 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a231bf66-cafc-4127-98de-f5ecdae8a3c3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:01.374537 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a231bf66-cafc-4127-98de-f5ecdae8a3c3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:01.374970 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a231bf66-cafc-4127-98de-f5ecdae8a3c3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:01.473245 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-c42c4c14-139a-4398-a1ba-cde6febb9663 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:01.481764 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-c42c4c14-139a-4398-a1ba-cde6febb9663 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6" status: 200 len: 1513 microversion: 2.1 time: 0.167486 Nov 23 09:02:01.482965 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 282/566] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:01 2021] GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:01.533849 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a231bf66-cafc-4127-98de-f5ecdae8a3c3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:01.544725 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a231bf66-cafc-4127-98de-f5ecdae8a3c3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:01.546653 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a231bf66-cafc-4127-98de-f5ecdae8a3c3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:01.547999 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a231bf66-cafc-4127-98de-f5ecdae8a3c3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1809 microversion: 2.20 time: 0.194880 Nov 23 09:02:01.548691 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 285/567] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:02:01 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:02:01.987707 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-0c188760-132c-4f79-a001-21e0eadd11c8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:01.988261 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-0c188760-132c-4f79-a001-21e0eadd11c8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:01.994321 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0c188760-132c-4f79-a001-21e0eadd11c8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:01.995395 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0c188760-132c-4f79-a001-21e0eadd11c8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:01.996186 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0c188760-132c-4f79-a001-21e0eadd11c8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:01.996623 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0c188760-132c-4f79-a001-21e0eadd11c8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:02.150503 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-0c188760-132c-4f79-a001-21e0eadd11c8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:02.159422 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-0c188760-132c-4f79-a001-21e0eadd11c8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1520 microversion: 2.1 time: 0.175407 Nov 23 09:02:02.160765 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 283/568] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:01 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:02.500894 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-aceee5c8-1aa9-4ad3-bdd7-2e8467220e81 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:02.501698 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-aceee5c8-1aa9-4ad3-bdd7-2e8467220e81 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: d24b89a9-3395-4744-8c8c-7cb14a68dae6] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:02.508576 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-aceee5c8-1aa9-4ad3-bdd7-2e8467220e81 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:02.509067 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-aceee5c8-1aa9-4ad3-bdd7-2e8467220e81 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:02.510020 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-aceee5c8-1aa9-4ad3-bdd7-2e8467220e81 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:02.510590 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-aceee5c8-1aa9-4ad3-bdd7-2e8467220e81 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:02.568033 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-f1ab2ac8-eea8-4063-98e4-8e12f5902e28 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:02.569277 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-f1ab2ac8-eea8-4063-98e4-8e12f5902e28 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:02.576434 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f1ab2ac8-eea8-4063-98e4-8e12f5902e28 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:02.576997 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f1ab2ac8-eea8-4063-98e4-8e12f5902e28 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:02.577936 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f1ab2ac8-eea8-4063-98e4-8e12f5902e28 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:02.578537 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f1ab2ac8-eea8-4063-98e4-8e12f5902e28 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:02.669834 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-aceee5c8-1aa9-4ad3-bdd7-2e8467220e81 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:02.677326 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-aceee5c8-1aa9-4ad3-bdd7-2e8467220e81 tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6" status: 200 len: 1513 microversion: 2.1 time: 0.180316 Nov 23 09:02:02.677891 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 286/569] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:02 2021] GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6 => generated 1513 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:02.750688 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-f1ab2ac8-eea8-4063-98e4-8e12f5902e28 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:02.759888 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-f1ab2ac8-eea8-4063-98e4-8e12f5902e28 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:02.761964 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-f1ab2ac8-eea8-4063-98e4-8e12f5902e28 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:02.763183 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-f1ab2ac8-eea8-4063-98e4-8e12f5902e28 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1809 microversion: 2.20 time: 0.199267 Nov 23 09:02:02.763754 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 284/570] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:02:02 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1809 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 09:02:03.177536 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e9f47410-3926-45da-8e9a-d9d07601b4b8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:03.178211 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e9f47410-3926-45da-8e9a-d9d07601b4b8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:03.184397 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e9f47410-3926-45da-8e9a-d9d07601b4b8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:03.184852 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e9f47410-3926-45da-8e9a-d9d07601b4b8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:03.185677 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e9f47410-3926-45da-8e9a-d9d07601b4b8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:03.186111 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e9f47410-3926-45da-8e9a-d9d07601b4b8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:03.324319 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-e9f47410-3926-45da-8e9a-d9d07601b4b8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:03.331867 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e9f47410-3926-45da-8e9a-d9d07601b4b8 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1520 microversion: 2.1 time: 0.158300 Nov 23 09:02:03.332436 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 287/571] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:03 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:03.695634 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-51c8aecd-2362-413c-93ad-8904d9e939ce tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:03.696236 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-51c8aecd-2362-413c-93ad-8904d9e939ce tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: d24b89a9-3395-4744-8c8c-7cb14a68dae6] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:03.702747 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-51c8aecd-2362-413c-93ad-8904d9e939ce tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:03.703193 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-51c8aecd-2362-413c-93ad-8904d9e939ce tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:03.703967 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-51c8aecd-2362-413c-93ad-8904d9e939ce tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:03.704402 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-51c8aecd-2362-413c-93ad-8904d9e939ce tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:03.784001 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-fd895c01-9958-4b9e-9f12-471ef1a0c6c6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:03.784634 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-fd895c01-9958-4b9e-9f12-471ef1a0c6c6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:03.791774 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fd895c01-9958-4b9e-9f12-471ef1a0c6c6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:03.792310 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fd895c01-9958-4b9e-9f12-471ef1a0c6c6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:03.793021 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fd895c01-9958-4b9e-9f12-471ef1a0c6c6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:03.793491 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fd895c01-9958-4b9e-9f12-471ef1a0c6c6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:03.845208 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-51c8aecd-2362-413c-93ad-8904d9e939ce tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:03.855327 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-51c8aecd-2362-413c-93ad-8904d9e939ce tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6" status: 200 len: 1513 microversion: 2.1 time: 0.163258 Nov 23 09:02:03.855925 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 285/572] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:03 2021] GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:03.939325 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-fd895c01-9958-4b9e-9f12-471ef1a0c6c6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:03.948412 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-fd895c01-9958-4b9e-9f12-471ef1a0c6c6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:03.949999 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-fd895c01-9958-4b9e-9f12-471ef1a0c6c6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:03.951140 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-fd895c01-9958-4b9e-9f12-471ef1a0c6c6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1809 microversion: 2.20 time: 0.171053 Nov 23 09:02:03.951690 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 288/573] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:02:03 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 09:02:04.349432 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-a76fb3f7-e769-4ace-84ba-251b7c594f77 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:04.349973 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-a76fb3f7-e769-4ace-84ba-251b7c594f77 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:04.355734 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a76fb3f7-e769-4ace-84ba-251b7c594f77 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:04.356181 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a76fb3f7-e769-4ace-84ba-251b7c594f77 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:04.356956 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a76fb3f7-e769-4ace-84ba-251b7c594f77 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:04.357409 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a76fb3f7-e769-4ace-84ba-251b7c594f77 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:04.488552 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-a76fb3f7-e769-4ace-84ba-251b7c594f77 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:04.496903 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-a76fb3f7-e769-4ace-84ba-251b7c594f77 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1520 microversion: 2.1 time: 0.151232 Nov 23 09:02:04.497510 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 286/574] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:04 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:04.880716 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-9fcd1596-413b-4cdf-9c6c-4d6471ef528e tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:04.881423 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-9fcd1596-413b-4cdf-9c6c-4d6471ef528e tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: d24b89a9-3395-4744-8c8c-7cb14a68dae6] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:04.888412 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9fcd1596-413b-4cdf-9c6c-4d6471ef528e tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:04.888896 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9fcd1596-413b-4cdf-9c6c-4d6471ef528e tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:04.890295 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9fcd1596-413b-4cdf-9c6c-4d6471ef528e tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:04.890295 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9fcd1596-413b-4cdf-9c6c-4d6471ef528e tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:04.972955 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-9397f313-1dea-44bb-90ba-199c02e2e715 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:04.973641 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-9397f313-1dea-44bb-90ba-199c02e2e715 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:04.981337 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9397f313-1dea-44bb-90ba-199c02e2e715 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:04.981807 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9397f313-1dea-44bb-90ba-199c02e2e715 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:04.982660 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9397f313-1dea-44bb-90ba-199c02e2e715 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:04.983114 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9397f313-1dea-44bb-90ba-199c02e2e715 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:05.026677 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-9fcd1596-413b-4cdf-9c6c-4d6471ef528e tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:05.034155 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-9fcd1596-413b-4cdf-9c6c-4d6471ef528e tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6" status: 200 len: 1513 microversion: 2.1 time: 0.157226 Nov 23 09:02:05.034783 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 289/575] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:04 2021] GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:05.116099 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-9397f313-1dea-44bb-90ba-199c02e2e715 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:05.125280 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-9397f313-1dea-44bb-90ba-199c02e2e715 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:05.126829 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-9397f313-1dea-44bb-90ba-199c02e2e715 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:05.127981 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-9397f313-1dea-44bb-90ba-199c02e2e715 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1809 microversion: 2.20 time: 0.161849 Nov 23 09:02:05.128540 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 287/576] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:02:04 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:02:05.514214 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-4d0f1000-a5b6-462b-be7a-a37171b95fa2 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:05.514817 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-4d0f1000-a5b6-462b-be7a-a37171b95fa2 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:05.520544 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4d0f1000-a5b6-462b-be7a-a37171b95fa2 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:05.520989 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4d0f1000-a5b6-462b-be7a-a37171b95fa2 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:05.521784 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4d0f1000-a5b6-462b-be7a-a37171b95fa2 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:05.522219 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4d0f1000-a5b6-462b-be7a-a37171b95fa2 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:05.655188 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-4d0f1000-a5b6-462b-be7a-a37171b95fa2 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:05.662487 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-4d0f1000-a5b6-462b-be7a-a37171b95fa2 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1520 microversion: 2.1 time: 0.152014 Nov 23 09:02:05.663051 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 290/577] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:05 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:06.051982 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-949a9f87-204a-47d4-b04b-c625a56235fc tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:06.053352 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-949a9f87-204a-47d4-b04b-c625a56235fc tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: d24b89a9-3395-4744-8c8c-7cb14a68dae6] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:06.061847 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-949a9f87-204a-47d4-b04b-c625a56235fc tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:06.062311 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-949a9f87-204a-47d4-b04b-c625a56235fc tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:06.063112 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-949a9f87-204a-47d4-b04b-c625a56235fc tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:06.063561 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-949a9f87-204a-47d4-b04b-c625a56235fc tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:06.142145 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-949a9f87-204a-47d4-b04b-c625a56235fc tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aab4af24a784bd29062cfb1f27e37b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc96d46a97c943aca49c42bd6ba512a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:06.148665 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-ca49711a-777a-4612-b501-999f503b9a9c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:06.149433 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-ca49711a-777a-4612-b501-999f503b9a9c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:06.151483 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-949a9f87-204a-47d4-b04b-c625a56235fc tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6" status: 200 len: 1471 microversion: 2.1 time: 0.103326 Nov 23 09:02:06.157876 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ca49711a-777a-4612-b501-999f503b9a9c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:06.158606 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ca49711a-777a-4612-b501-999f503b9a9c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:06.159351 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 288/578] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:06 2021] GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6 => generated 1471 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:06.159972 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ca49711a-777a-4612-b501-999f503b9a9c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:06.160964 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ca49711a-777a-4612-b501-999f503b9a9c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:06.167809 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-0b977fde-a3c3-4178-93bb-341ee761b37a req-8d1347e5-ad2a-4131-b3cc-50c5907ffc53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d24b89a9-3395-4744-8c8c-7cb14a68dae6", "name": "network-vif-deleted", "tag": "5e0eff58-402c-44b7-93a7-cb46a2d7e9b1"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:02:06.170276 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:02:06.170276 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 09:02:06.178406 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-0b977fde-a3c3-4178-93bb-341ee761b37a req-8d1347e5-ad2a-4131-b3cc-50c5907ffc53 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:06.178881 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-0b977fde-a3c3-4178-93bb-341ee761b37a req-8d1347e5-ad2a-4131-b3cc-50c5907ffc53 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:06.191817 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-0b977fde-a3c3-4178-93bb-341ee761b37a req-8d1347e5-ad2a-4131-b3cc-50c5907ffc53 service nova] Creating event network-vif-deleted:5e0eff58-402c-44b7-93a7-cb46a2d7e9b1 for instance d24b89a9-3395-4744-8c8c-7cb14a68dae6 on hv-cinder-76845 Nov 23 09:02:06.198431 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-0b977fde-a3c3-4178-93bb-341ee761b37a req-8d1347e5-ad2a-4131-b3cc-50c5907ffc53 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036626 Nov 23 09:02:06.199232 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 289/579] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:02:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:02:06.305198 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-ca49711a-777a-4612-b501-999f503b9a9c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:06.313871 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-ca49711a-777a-4612-b501-999f503b9a9c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:06.315296 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-ca49711a-777a-4612-b501-999f503b9a9c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:06.316436 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-ca49711a-777a-4612-b501-999f503b9a9c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1809 microversion: 2.20 time: 0.173321 Nov 23 09:02:06.316993 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 291/580] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:02:06 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:02:06.680119 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-90eb6d57-94b0-46a8-96ec-97317477129c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:06.680878 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-90eb6d57-94b0-46a8-96ec-97317477129c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:06.688131 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-90eb6d57-94b0-46a8-96ec-97317477129c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:06.688600 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-90eb6d57-94b0-46a8-96ec-97317477129c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:06.689420 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-90eb6d57-94b0-46a8-96ec-97317477129c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:06.689858 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-90eb6d57-94b0-46a8-96ec-97317477129c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:06.825189 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-90eb6d57-94b0-46a8-96ec-97317477129c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:06.832534 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-90eb6d57-94b0-46a8-96ec-97317477129c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1520 microversion: 2.1 time: 0.156408 Nov 23 09:02:06.833086 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 290/581] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:06 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:07.169556 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-38eb7893-10f4-40d2-8f8b-9e66f2b82b5d tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:07.170159 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-38eb7893-10f4-40d2-8f8b-9e66f2b82b5d tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] [instance: d24b89a9-3395-4744-8c8c-7cb14a68dae6] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:07.176340 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-38eb7893-10f4-40d2-8f8b-9e66f2b82b5d tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:07.176795 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-38eb7893-10f4-40d2-8f8b-9e66f2b82b5d tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:07.177608 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-38eb7893-10f4-40d2-8f8b-9e66f2b82b5d tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:07.178042 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-38eb7893-10f4-40d2-8f8b-9e66f2b82b5d tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:07.190873 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-38eb7893-10f4-40d2-8f8b-9e66f2b82b5d tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] HTTP exception thrown: Instance d24b89a9-3395-4744-8c8c-7cb14a68dae6 could not be found. Nov 23 09:02:07.191447 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-38eb7893-10f4-40d2-8f8b-9e66f2b82b5d tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] Returning 404 to user: Instance d24b89a9-3395-4744-8c8c-7cb14a68dae6 could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 09:02:07.192254 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-38eb7893-10f4-40d2-8f8b-9e66f2b82b5d tempest-VolumesSnapshotTestJSON-1779426563 tempest-VolumesSnapshotTestJSON-1779426563-project] 10.222.0.46 "GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6" status: 404 len: 111 microversion: 2.1 time: 0.026512 Nov 23 09:02:07.192773 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 292/582] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:07 2021] GET /compute/v2.1/servers/d24b89a9-3395-4744-8c8c-7cb14a68dae6 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 09:02:07.335656 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-8962da06-2e6c-4941-9322-14a69868b5b3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:07.336292 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-8962da06-2e6c-4941-9322-14a69868b5b3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:07.343002 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8962da06-2e6c-4941-9322-14a69868b5b3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:07.343461 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8962da06-2e6c-4941-9322-14a69868b5b3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:07.344266 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8962da06-2e6c-4941-9322-14a69868b5b3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:07.344688 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8962da06-2e6c-4941-9322-14a69868b5b3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:07.489538 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-8962da06-2e6c-4941-9322-14a69868b5b3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:07.498251 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-8962da06-2e6c-4941-9322-14a69868b5b3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:07.499750 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-8962da06-2e6c-4941-9322-14a69868b5b3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:07.500903 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-8962da06-2e6c-4941-9322-14a69868b5b3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1809 microversion: 2.20 time: 0.169417 Nov 23 09:02:07.501500 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 291/583] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:02:07 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 09:02:07.850480 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-68fae7aa-aaf1-4509-b0d2-90374cb6018c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:07.851140 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-68fae7aa-aaf1-4509-b0d2-90374cb6018c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:07.857780 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-68fae7aa-aaf1-4509-b0d2-90374cb6018c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:07.858231 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-68fae7aa-aaf1-4509-b0d2-90374cb6018c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:07.859006 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-68fae7aa-aaf1-4509-b0d2-90374cb6018c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:07.859440 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-68fae7aa-aaf1-4509-b0d2-90374cb6018c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:07.991676 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-68fae7aa-aaf1-4509-b0d2-90374cb6018c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:07.999840 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-68fae7aa-aaf1-4509-b0d2-90374cb6018c tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1520 microversion: 2.1 time: 0.152981 Nov 23 09:02:08.000442 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 293/584] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:07 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:08.214122 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-6bc011c9-d30f-4073-8cda-fd4829323cc2 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2019571221", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1835873804", "security_groups": [{"name": "tempest-secgroup-smoke-474799054"}], "block_device_mapping_v2": [{"uuid": "bd38a92c-8148-42ff-8c5b-bff161548fc6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d2703dbd-849e-45eb-9768-17f699057b49"}]}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:02:08.329713 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.network.neutron [None req-6bc011c9-d30f-4073-8cda-fd4829323cc2 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] validate_networks() for [('d2703dbd-849e-45eb-9768-17f699057b49', None, None, None, None, None)] {{(pid=116227) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 09:02:08.519318 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d04486bd-ab80-420e-b4d7-bed3b711308f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:08.520293 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d04486bd-ab80-420e-b4d7-bed3b711308f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:08.527566 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d04486bd-ab80-420e-b4d7-bed3b711308f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:08.528163 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d04486bd-ab80-420e-b4d7-bed3b711308f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:08.528804 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d04486bd-ab80-420e-b4d7-bed3b711308f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:08.529285 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d04486bd-ab80-420e-b4d7-bed3b711308f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:08.670016 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d04486bd-ab80-420e-b4d7-bed3b711308f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:08.679416 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d04486bd-ab80-420e-b4d7-bed3b711308f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:08.681727 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d04486bd-ab80-420e-b4d7-bed3b711308f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:08.683177 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d04486bd-ab80-420e-b4d7-bed3b711308f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1809 microversion: 2.20 time: 0.167511 Nov 23 09:02:08.683758 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 294/585] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:02:08 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 09:02:08.718183 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.virt.hardware [None req-6bc011c9-d30f-4073-8cda-fd4829323cc2 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Flavor limits 0:0:0 {{(pid=116227) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 09:02:08.718709 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.virt.hardware [None req-6bc011c9-d30f-4073-8cda-fd4829323cc2 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Image limits 0:0:0 {{(pid=116227) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 09:02:08.719063 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.virt.hardware [None req-6bc011c9-d30f-4073-8cda-fd4829323cc2 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Flavor pref 0:0:0 {{(pid=116227) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 09:02:08.719474 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.virt.hardware [None req-6bc011c9-d30f-4073-8cda-fd4829323cc2 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Image pref 0:0:0 {{(pid=116227) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 09:02:08.719883 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.virt.hardware [None req-6bc011c9-d30f-4073-8cda-fd4829323cc2 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116227) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 09:02:08.729413 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6bc011c9-d30f-4073-8cda-fd4829323cc2 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:08.729856 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6bc011c9-d30f-4073-8cda-fd4829323cc2 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:08.730673 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6bc011c9-d30f-4073-8cda-fd4829323cc2 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:08.731108 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6bc011c9-d30f-4073-8cda-fd4829323cc2 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:08.747594 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.quota [None req-6bc011c9-d30f-4073-8cda-fd4829323cc2 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Getting quotas for project 229671159ee9412ca1bcc93a838c73c1. Resources: {'instances', 'ram', 'cores'} {{(pid=116227) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 09:02:08.751455 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.quota [None req-6bc011c9-d30f-4073-8cda-fd4829323cc2 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Getting quotas for user 8e26aa2383ab4e5da1bdc6712f58af06 and project 229671159ee9412ca1bcc93a838c73c1. Resources: {'instances', 'ram', 'cores'} {{(pid=116227) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 09:02:08.805760 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-6bc011c9-d30f-4073-8cda-fd4829323cc2 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Going to run 1 instances... {{(pid=116227) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 09:02:08.807952 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-6bc011c9-d30f-4073-8cda-fd4829323cc2 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bd38a92c-8148-42ff-8c5b-bff161548fc6',volume_size=None,volume_type=None)] {{(pid=116227) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 09:02:08.934057 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-6bc011c9-d30f-4073-8cda-fd4829323cc2 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.724014 Nov 23 09:02:08.934726 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 292/586] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 23 09:02:08 2021] POST /compute/v2.1/servers => generated 405 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 09:02:08.944468 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8df46bd6-eaeb-41c9-8186-42be8b125596 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:08.945071 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-8df46bd6-eaeb-41c9-8186-42be8b125596 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:09.000595 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-8df46bd6-eaeb-41c9-8186-42be8b125596 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:09.007244 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-8df46bd6-eaeb-41c9-8186-42be8b125596 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22" status: 200 len: 1095 microversion: 2.1 time: 0.066327 Nov 23 09:02:09.007815 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 295/587] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:08 2021] GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:09.017441 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-f2dc2680-3748-497b-9391-d08194881619 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:09.018059 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-f2dc2680-3748-497b-9391-d08194881619 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:09.024125 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f2dc2680-3748-497b-9391-d08194881619 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:09.024580 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f2dc2680-3748-497b-9391-d08194881619 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:09.025953 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f2dc2680-3748-497b-9391-d08194881619 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:09.026521 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f2dc2680-3748-497b-9391-d08194881619 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:09.172579 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-f2dc2680-3748-497b-9391-d08194881619 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:09.180231 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-f2dc2680-3748-497b-9391-d08194881619 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1520 microversion: 2.1 time: 0.166326 Nov 23 09:02:09.181090 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 293/588] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:09 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:09.701238 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a4eb7ccc-d5ab-4188-bb16-7396b7bcf44a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:09.701878 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a4eb7ccc-d5ab-4188-bb16-7396b7bcf44a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:09.708688 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a4eb7ccc-d5ab-4188-bb16-7396b7bcf44a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:09.709151 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a4eb7ccc-d5ab-4188-bb16-7396b7bcf44a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:09.709967 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a4eb7ccc-d5ab-4188-bb16-7396b7bcf44a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:09.710411 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a4eb7ccc-d5ab-4188-bb16-7396b7bcf44a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:09.843655 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a4eb7ccc-d5ab-4188-bb16-7396b7bcf44a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:09.851908 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a4eb7ccc-d5ab-4188-bb16-7396b7bcf44a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:09.854515 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a4eb7ccc-d5ab-4188-bb16-7396b7bcf44a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:09.855793 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a4eb7ccc-d5ab-4188-bb16-7396b7bcf44a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1809 microversion: 2.20 time: 0.158240 Nov 23 09:02:09.856375 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 296/589] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:02:09 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:02:10.024811 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-8b7e40fb-4f22-44e3-bd20-e0540102f190 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:10.025410 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-8b7e40fb-4f22-44e3-bd20-e0540102f190 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:10.032269 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8b7e40fb-4f22-44e3-bd20-e0540102f190 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:10.032787 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8b7e40fb-4f22-44e3-bd20-e0540102f190 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:10.033711 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8b7e40fb-4f22-44e3-bd20-e0540102f190 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:10.034206 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8b7e40fb-4f22-44e3-bd20-e0540102f190 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:10.092220 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-8b7e40fb-4f22-44e3-bd20-e0540102f190 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:10.099802 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-8b7e40fb-4f22-44e3-bd20-e0540102f190 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22" status: 200 len: 1145 microversion: 2.1 time: 0.078742 Nov 23 09:02:10.100379 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 294/590] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:10 2021] GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:10.198300 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d787c8a7-be56-4d1b-a91c-1243bd4a74a3 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:10.198938 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d787c8a7-be56-4d1b-a91c-1243bd4a74a3 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:10.204656 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d787c8a7-be56-4d1b-a91c-1243bd4a74a3 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:10.205108 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d787c8a7-be56-4d1b-a91c-1243bd4a74a3 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:10.205913 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d787c8a7-be56-4d1b-a91c-1243bd4a74a3 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:10.206350 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d787c8a7-be56-4d1b-a91c-1243bd4a74a3 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:10.340247 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d787c8a7-be56-4d1b-a91c-1243bd4a74a3 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:10.348019 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d787c8a7-be56-4d1b-a91c-1243bd4a74a3 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1520 microversion: 2.1 time: 0.153496 Nov 23 09:02:10.348652 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 297/591] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:10 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:10.874759 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-1ca74e0e-8ee3-46c8-8831-8a677cb604d0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:10.875365 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-1ca74e0e-8ee3-46c8-8831-8a677cb604d0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:10.881269 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1ca74e0e-8ee3-46c8-8831-8a677cb604d0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:10.881723 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1ca74e0e-8ee3-46c8-8831-8a677cb604d0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:10.882537 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1ca74e0e-8ee3-46c8-8831-8a677cb604d0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:10.882969 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1ca74e0e-8ee3-46c8-8831-8a677cb604d0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:11.014280 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-1ca74e0e-8ee3-46c8-8831-8a677cb604d0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:11.022412 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-1ca74e0e-8ee3-46c8-8831-8a677cb604d0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:11.023901 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-1ca74e0e-8ee3-46c8-8831-8a677cb604d0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:11.025148 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-1ca74e0e-8ee3-46c8-8831-8a677cb604d0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1809 microversion: 2.20 time: 0.154099 Nov 23 09:02:11.025727 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 295/592] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:02:10 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:02:11.118204 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a3af72fa-d6cf-4280-a2b5-b8a6aba539ca tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:11.119164 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a3af72fa-d6cf-4280-a2b5-b8a6aba539ca tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:11.125676 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a3af72fa-d6cf-4280-a2b5-b8a6aba539ca tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:11.126129 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a3af72fa-d6cf-4280-a2b5-b8a6aba539ca tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:11.126907 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a3af72fa-d6cf-4280-a2b5-b8a6aba539ca tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:11.127346 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a3af72fa-d6cf-4280-a2b5-b8a6aba539ca tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:11.189084 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a3af72fa-d6cf-4280-a2b5-b8a6aba539ca tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:11.196234 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a3af72fa-d6cf-4280-a2b5-b8a6aba539ca tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22" status: 200 len: 1145 microversion: 2.1 time: 0.081783 Nov 23 09:02:11.197402 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 298/593] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:11 2021] GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:02:11.364936 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-56ccc44c-17b0-4704-8fed-d2c05b60b00f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:11.365646 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-56ccc44c-17b0-4704-8fed-d2c05b60b00f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:11.372647 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-56ccc44c-17b0-4704-8fed-d2c05b60b00f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:11.373094 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-56ccc44c-17b0-4704-8fed-d2c05b60b00f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:11.373891 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-56ccc44c-17b0-4704-8fed-d2c05b60b00f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:11.374323 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-56ccc44c-17b0-4704-8fed-d2c05b60b00f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:11.506236 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-56ccc44c-17b0-4704-8fed-d2c05b60b00f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:11.514159 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-56ccc44c-17b0-4704-8fed-d2c05b60b00f tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1520 microversion: 2.1 time: 0.153011 Nov 23 09:02:11.514756 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 296/594] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:11 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:12.043990 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e4a271f5-a185-4fc6-b772-4bcea3446683 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:12.044598 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e4a271f5-a185-4fc6-b772-4bcea3446683 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:12.050961 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e4a271f5-a185-4fc6-b772-4bcea3446683 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:12.051494 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e4a271f5-a185-4fc6-b772-4bcea3446683 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:12.052353 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e4a271f5-a185-4fc6-b772-4bcea3446683 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:12.052797 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e4a271f5-a185-4fc6-b772-4bcea3446683 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:12.187788 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-e4a271f5-a185-4fc6-b772-4bcea3446683 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:12.197687 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-e4a271f5-a185-4fc6-b772-4bcea3446683 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:12.199261 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-e4a271f5-a185-4fc6-b772-4bcea3446683 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:12.200417 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e4a271f5-a185-4fc6-b772-4bcea3446683 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1809 microversion: 2.20 time: 0.160990 Nov 23 09:02:12.200997 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 299/595] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:02:12 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:02:12.213141 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-032560ed-8401-4f41-ae60-de30efdfac00 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:12.213908 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-032560ed-8401-4f41-ae60-de30efdfac00 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:12.220283 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-032560ed-8401-4f41-ae60-de30efdfac00 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:12.220733 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-032560ed-8401-4f41-ae60-de30efdfac00 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:12.221549 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-032560ed-8401-4f41-ae60-de30efdfac00 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:12.221993 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-032560ed-8401-4f41-ae60-de30efdfac00 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:12.281982 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-032560ed-8401-4f41-ae60-de30efdfac00 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:12.289670 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-032560ed-8401-4f41-ae60-de30efdfac00 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22" status: 200 len: 1137 microversion: 2.1 time: 0.080738 Nov 23 09:02:12.291086 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 297/596] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:12 2021] GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 => generated 1137 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:12.533938 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-62bf943f-bde8-4c1c-bb74-8aca785bf1c1 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:12.534545 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-62bf943f-bde8-4c1c-bb74-8aca785bf1c1 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:12.540423 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-62bf943f-bde8-4c1c-bb74-8aca785bf1c1 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:12.540934 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-62bf943f-bde8-4c1c-bb74-8aca785bf1c1 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:12.541754 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-62bf943f-bde8-4c1c-bb74-8aca785bf1c1 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:12.542195 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-62bf943f-bde8-4c1c-bb74-8aca785bf1c1 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:12.753142 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-62bf943f-bde8-4c1c-bb74-8aca785bf1c1 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c4f403b6604aa796ab8da53c0803b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0e7a1377f47a380bd0bb5a9c9ef48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:12.762780 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-62bf943f-bde8-4c1c-bb74-8aca785bf1c1 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 200 len: 1520 microversion: 2.1 time: 0.232409 Nov 23 09:02:12.763635 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 300/597] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:12 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:13.156090 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-d1405f91-67f4-4912-842d-a52d412dd7c5 req-ddc472e4-abb3-485d-9d56-f4bd3fb0bfab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e7614ff-90ad-4ed2-9d48-3b0585258f88", "name": "network-vif-deleted", "tag": "6a5bc769-b686-4f1b-aa8b-1993d134c1f8"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:02:13.157715 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:02:13.157715 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 09:02:13.167264 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-d1405f91-67f4-4912-842d-a52d412dd7c5 req-ddc472e4-abb3-485d-9d56-f4bd3fb0bfab service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:13.168099 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-d1405f91-67f4-4912-842d-a52d412dd7c5 req-ddc472e4-abb3-485d-9d56-f4bd3fb0bfab service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:13.201377 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-d1405f91-67f4-4912-842d-a52d412dd7c5 req-ddc472e4-abb3-485d-9d56-f4bd3fb0bfab service nova] Creating event network-vif-deleted:6a5bc769-b686-4f1b-aa8b-1993d134c1f8 for instance 4e7614ff-90ad-4ed2-9d48-3b0585258f88 on hv-cinder-76845 Nov 23 09:02:13.206925 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-d1405f91-67f4-4912-842d-a52d412dd7c5 req-ddc472e4-abb3-485d-9d56-f4bd3fb0bfab service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054609 Nov 23 09:02:13.207944 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 298/598] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:02:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:02:13.220752 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b4abfd6c-187b-4028-b243-7e6f0d0a9240 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:13.221833 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b4abfd6c-187b-4028-b243-7e6f0d0a9240 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:13.231252 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b4abfd6c-187b-4028-b243-7e6f0d0a9240 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:13.232229 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b4abfd6c-187b-4028-b243-7e6f0d0a9240 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:13.233992 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b4abfd6c-187b-4028-b243-7e6f0d0a9240 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:13.234807 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b4abfd6c-187b-4028-b243-7e6f0d0a9240 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:13.311298 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-4e727928-57ff-4a0f-bede-89eb0ccbcb34 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:13.315019 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-4e727928-57ff-4a0f-bede-89eb0ccbcb34 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:13.327370 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4e727928-57ff-4a0f-bede-89eb0ccbcb34 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:13.327966 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4e727928-57ff-4a0f-bede-89eb0ccbcb34 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:13.329111 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4e727928-57ff-4a0f-bede-89eb0ccbcb34 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:13.329864 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4e727928-57ff-4a0f-bede-89eb0ccbcb34 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:13.429042 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b4abfd6c-187b-4028-b243-7e6f0d0a9240 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:13.439607 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b4abfd6c-187b-4028-b243-7e6f0d0a9240 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:13.441287 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b4abfd6c-187b-4028-b243-7e6f0d0a9240 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:13.442508 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b4abfd6c-187b-4028-b243-7e6f0d0a9240 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1809 microversion: 2.20 time: 0.226974 Nov 23 09:02:13.443113 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 301/599] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:02:13 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1809 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:02:13.677667 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-4e727928-57ff-4a0f-bede-89eb0ccbcb34 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:13.686313 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-4e727928-57ff-4a0f-bede-89eb0ccbcb34 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22" status: 200 len: 1211 microversion: 2.1 time: 0.381901 Nov 23 09:02:13.702639 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 299/600] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:13 2021] GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 => generated 1211 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:13.780995 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-7d1065fa-af9e-4cef-9ca8-25caaf14bd22 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:13.781826 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-7d1065fa-af9e-4cef-9ca8-25caaf14bd22 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] [instance: 4e7614ff-90ad-4ed2-9d48-3b0585258f88] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:13.788750 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7d1065fa-af9e-4cef-9ca8-25caaf14bd22 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:13.789967 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7d1065fa-af9e-4cef-9ca8-25caaf14bd22 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:13.791337 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7d1065fa-af9e-4cef-9ca8-25caaf14bd22 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:13.792563 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7d1065fa-af9e-4cef-9ca8-25caaf14bd22 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:13.810499 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-7d1065fa-af9e-4cef-9ca8-25caaf14bd22 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] HTTP exception thrown: Instance 4e7614ff-90ad-4ed2-9d48-3b0585258f88 could not be found. Nov 23 09:02:13.811382 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-7d1065fa-af9e-4cef-9ca8-25caaf14bd22 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] Returning 404 to user: Instance 4e7614ff-90ad-4ed2-9d48-3b0585258f88 could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 09:02:13.812641 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-7d1065fa-af9e-4cef-9ca8-25caaf14bd22 tempest-ServerRescueNegativeTestJSON-1633064154 tempest-ServerRescueNegativeTestJSON-1633064154-project] 10.222.0.46 "GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88" status: 404 len: 111 microversion: 2.1 time: 0.035700 Nov 23 09:02:13.825427 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 302/601] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:13 2021] GET /compute/v2.1/servers/4e7614ff-90ad-4ed2-9d48-3b0585258f88 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 09:02:14.462102 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-5f137757-f512-48d9-b38a-367d6105a873 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:14.462844 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-5f137757-f512-48d9-b38a-367d6105a873 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:14.478436 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5f137757-f512-48d9-b38a-367d6105a873 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:14.484590 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5f137757-f512-48d9-b38a-367d6105a873 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:14.485659 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5f137757-f512-48d9-b38a-367d6105a873 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:14.490278 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5f137757-f512-48d9-b38a-367d6105a873 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:14.704809 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-6fbecc50-06a5-4509-b72c-8fe8a846394b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:14.705565 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-6fbecc50-06a5-4509-b72c-8fe8a846394b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:14.714099 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6fbecc50-06a5-4509-b72c-8fe8a846394b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:14.716220 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6fbecc50-06a5-4509-b72c-8fe8a846394b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:14.718918 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6fbecc50-06a5-4509-b72c-8fe8a846394b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:14.720325 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6fbecc50-06a5-4509-b72c-8fe8a846394b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:14.801790 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-5f137757-f512-48d9-b38a-367d6105a873 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:14.812937 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-5f137757-f512-48d9-b38a-367d6105a873 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:14.815402 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-5f137757-f512-48d9-b38a-367d6105a873 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:14.818495 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-5f137757-f512-48d9-b38a-367d6105a873 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1809 microversion: 2.20 time: 0.360169 Nov 23 09:02:14.822041 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 300/602] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:02:14 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1809 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:02:14.930031 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-c9fdd6d9-209a-409e-8cf1-262c04dcc5aa req-e6c3945c-d53c-4fad-9bc0-e47a7d27b4df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fcc9f31-a3b6-4476-9c2f-6b22faa98e22", "tag": "51572632-a474-4f0a-8d0a-5d7f7a5f7e61"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:02:14.933757 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:02:14.933757 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 09:02:14.949148 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-c9fdd6d9-209a-409e-8cf1-262c04dcc5aa req-e6c3945c-d53c-4fad-9bc0-e47a7d27b4df service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:14.950021 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-c9fdd6d9-209a-409e-8cf1-262c04dcc5aa req-e6c3945c-d53c-4fad-9bc0-e47a7d27b4df service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:14.966706 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-c9fdd6d9-209a-409e-8cf1-262c04dcc5aa req-e6c3945c-d53c-4fad-9bc0-e47a7d27b4df service nova] Creating event network-changed:51572632-a474-4f0a-8d0a-5d7f7a5f7e61 for instance 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 on hv-cinder-76845 Nov 23 09:02:14.972747 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-c9fdd6d9-209a-409e-8cf1-262c04dcc5aa req-e6c3945c-d53c-4fad-9bc0-e47a7d27b4df service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049444 Nov 23 09:02:14.973836 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 301/603] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:02:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 09:02:14.998241 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-6fbecc50-06a5-4509-b72c-8fe8a846394b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:15.013212 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-6fbecc50-06a5-4509-b72c-8fe8a846394b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22" status: 200 len: 1266 microversion: 2.1 time: 0.310751 Nov 23 09:02:15.014469 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 303/604] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:14 2021] GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 => generated 1266 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:02:15.838893 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-5196d029-ae07-4049-9403-4d517fa8e4c1 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:15.839765 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-5196d029-ae07-4049-9403-4d517fa8e4c1 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:15.849773 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5196d029-ae07-4049-9403-4d517fa8e4c1 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:15.850512 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5196d029-ae07-4049-9403-4d517fa8e4c1 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:15.852139 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5196d029-ae07-4049-9403-4d517fa8e4c1 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:15.854231 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5196d029-ae07-4049-9403-4d517fa8e4c1 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:15.956822 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-36a4460f-403b-4578-8232-7fe698df43ae req-1a4ccffd-126d-4146-9eed-f649f4ba9536 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82569d71-833c-454b-a668-12dc9a37e7e2", "name": "network-vif-plugged", "status": "completed", "tag": "efe7e8ac-f495-4361-902c-7da559e50715"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:02:15.958602 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:02:15.958602 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 09:02:15.968551 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-36a4460f-403b-4578-8232-7fe698df43ae req-1a4ccffd-126d-4146-9eed-f649f4ba9536 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:15.969257 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-36a4460f-403b-4578-8232-7fe698df43ae req-1a4ccffd-126d-4146-9eed-f649f4ba9536 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:15.981655 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-36a4460f-403b-4578-8232-7fe698df43ae req-1a4ccffd-126d-4146-9eed-f649f4ba9536 service nova] Creating event network-vif-plugged:efe7e8ac-f495-4361-902c-7da559e50715 for instance 82569d71-833c-454b-a668-12dc9a37e7e2 on hv-cinder-76845 Nov 23 09:02:15.988343 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-36a4460f-403b-4578-8232-7fe698df43ae req-1a4ccffd-126d-4146-9eed-f649f4ba9536 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034932 Nov 23 09:02:15.989798 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 304/605] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:02:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 09:02:16.039272 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-9ec1ea6f-827b-4d81-b6b3-ba9b5528e088 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:16.040398 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-9ec1ea6f-827b-4d81-b6b3-ba9b5528e088 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:16.049343 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9ec1ea6f-827b-4d81-b6b3-ba9b5528e088 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:16.050279 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9ec1ea6f-827b-4d81-b6b3-ba9b5528e088 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:16.052687 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9ec1ea6f-827b-4d81-b6b3-ba9b5528e088 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:16.053840 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9ec1ea6f-827b-4d81-b6b3-ba9b5528e088 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:16.269039 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-5196d029-ae07-4049-9403-4d517fa8e4c1 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:16.283741 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-5196d029-ae07-4049-9403-4d517fa8e4c1 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:16.287297 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-5196d029-ae07-4049-9403-4d517fa8e4c1 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:16.293220 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-5196d029-ae07-4049-9403-4d517fa8e4c1 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1809 microversion: 2.20 time: 0.458557 Nov 23 09:02:16.302192 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 302/606] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:02:15 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1809 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:02:16.355232 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-9ec1ea6f-827b-4d81-b6b3-ba9b5528e088 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:16.366195 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-9ec1ea6f-827b-4d81-b6b3-ba9b5528e088 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22" status: 200 len: 1266 microversion: 2.1 time: 0.335511 Nov 23 09:02:16.367472 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 305/607] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:16 2021] GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 => generated 1266 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:17.315136 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-2b3e0014-f90d-4200-8c84-7178b6ec503a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:17.316632 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-2b3e0014-f90d-4200-8c84-7178b6ec503a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:17.332040 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2b3e0014-f90d-4200-8c84-7178b6ec503a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:17.335974 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2b3e0014-f90d-4200-8c84-7178b6ec503a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:17.335974 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2b3e0014-f90d-4200-8c84-7178b6ec503a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:17.335974 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2b3e0014-f90d-4200-8c84-7178b6ec503a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:17.383565 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-fcec55de-c383-435d-8828-7724f955d888 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:17.384571 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-fcec55de-c383-435d-8828-7724f955d888 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:17.390976 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fcec55de-c383-435d-8828-7724f955d888 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:17.391716 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fcec55de-c383-435d-8828-7724f955d888 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:17.392739 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fcec55de-c383-435d-8828-7724f955d888 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:17.393427 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fcec55de-c383-435d-8828-7724f955d888 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:17.496003 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-2b3e0014-f90d-4200-8c84-7178b6ec503a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:17.504317 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-2b3e0014-f90d-4200-8c84-7178b6ec503a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:17.506136 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-2b3e0014-f90d-4200-8c84-7178b6ec503a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:17.507481 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-2b3e0014-f90d-4200-8c84-7178b6ec503a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1809 microversion: 2.20 time: 0.197015 Nov 23 09:02:17.508191 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 303/608] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:02:17 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1809 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 09:02:17.642018 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-fcec55de-c383-435d-8828-7724f955d888 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:17.647701 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-fcec55de-c383-435d-8828-7724f955d888 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22" status: 200 len: 1266 microversion: 2.1 time: 0.267596 Nov 23 09:02:17.649031 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 306/609] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:17 2021] GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 => generated 1266 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:02:18.526714 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-e4b822b8-aa0a-49ae-8f14-3ea8185a6d59 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:18.527940 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-e4b822b8-aa0a-49ae-8f14-3ea8185a6d59 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:18.534817 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e4b822b8-aa0a-49ae-8f14-3ea8185a6d59 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:18.535300 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e4b822b8-aa0a-49ae-8f14-3ea8185a6d59 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:18.536080 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e4b822b8-aa0a-49ae-8f14-3ea8185a6d59 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:18.536509 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e4b822b8-aa0a-49ae-8f14-3ea8185a6d59 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:18.667069 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-7704d291-fa45-4b58-afc6-5e12e501873e tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:18.667710 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-7704d291-fa45-4b58-afc6-5e12e501873e tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:18.698174 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7704d291-fa45-4b58-afc6-5e12e501873e tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:18.698174 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7704d291-fa45-4b58-afc6-5e12e501873e tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:18.698174 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7704d291-fa45-4b58-afc6-5e12e501873e tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:18.698174 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7704d291-fa45-4b58-afc6-5e12e501873e tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:18.705511 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-e4b822b8-aa0a-49ae-8f14-3ea8185a6d59 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:18.719458 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-e4b822b8-aa0a-49ae-8f14-3ea8185a6d59 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:18.720982 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-e4b822b8-aa0a-49ae-8f14-3ea8185a6d59 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:18.722216 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-e4b822b8-aa0a-49ae-8f14-3ea8185a6d59 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1809 microversion: 2.20 time: 0.200017 Nov 23 09:02:18.725117 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 304/610] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:02:18 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1809 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:02:18.890870 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-7704d291-fa45-4b58-afc6-5e12e501873e tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:18.898573 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-7704d291-fa45-4b58-afc6-5e12e501873e tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22" status: 200 len: 1266 microversion: 2.1 time: 0.236798 Nov 23 09:02:18.900463 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 307/611] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:18 2021] GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:02:19.742283 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-578ff007-7bf6-41e4-8c97-340eb7358d77 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:19.742890 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-578ff007-7bf6-41e4-8c97-340eb7358d77 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:19.749406 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-578ff007-7bf6-41e4-8c97-340eb7358d77 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:19.750061 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-578ff007-7bf6-41e4-8c97-340eb7358d77 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:19.750851 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-578ff007-7bf6-41e4-8c97-340eb7358d77 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:19.751284 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-578ff007-7bf6-41e4-8c97-340eb7358d77 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:19.896214 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-578ff007-7bf6-41e4-8c97-340eb7358d77 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:19.905801 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-578ff007-7bf6-41e4-8c97-340eb7358d77 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:19.907445 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-578ff007-7bf6-41e4-8c97-340eb7358d77 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:19.908470 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-578ff007-7bf6-41e4-8c97-340eb7358d77 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1809 microversion: 2.20 time: 0.170344 Nov 23 09:02:19.909059 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 305/612] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:02:19 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 09:02:19.916814 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-db565194-52cb-449c-8f94-7114f29e841b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:19.917564 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-db565194-52cb-449c-8f94-7114f29e841b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:19.923863 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-db565194-52cb-449c-8f94-7114f29e841b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:19.924341 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-db565194-52cb-449c-8f94-7114f29e841b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:19.925122 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-db565194-52cb-449c-8f94-7114f29e841b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:19.925592 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-db565194-52cb-449c-8f94-7114f29e841b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:20.054007 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-db565194-52cb-449c-8f94-7114f29e841b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:20.061749 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-db565194-52cb-449c-8f94-7114f29e841b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22" status: 200 len: 1266 microversion: 2.1 time: 0.149498 Nov 23 09:02:20.062327 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 308/613] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:19 2021] GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:20.927051 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-5f54ea94-7bb0-4f82-a322-a9690129033e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:20.927741 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-5f54ea94-7bb0-4f82-a322-a9690129033e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:20.934703 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5f54ea94-7bb0-4f82-a322-a9690129033e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:20.935320 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5f54ea94-7bb0-4f82-a322-a9690129033e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:20.936031 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5f54ea94-7bb0-4f82-a322-a9690129033e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:20.936495 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5f54ea94-7bb0-4f82-a322-a9690129033e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:21.078837 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-4ac04b2a-111c-4633-abac-fefec74e0f7e tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:21.079823 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-4ac04b2a-111c-4633-abac-fefec74e0f7e tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:21.081202 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-5f54ea94-7bb0-4f82-a322-a9690129033e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:21.088440 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4ac04b2a-111c-4633-abac-fefec74e0f7e tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:21.089141 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4ac04b2a-111c-4633-abac-fefec74e0f7e tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:21.090502 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4ac04b2a-111c-4633-abac-fefec74e0f7e tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:21.091014 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4ac04b2a-111c-4633-abac-fefec74e0f7e tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:21.091750 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-5f54ea94-7bb0-4f82-a322-a9690129033e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:21.093619 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-5f54ea94-7bb0-4f82-a322-a9690129033e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:21.094981 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-5f54ea94-7bb0-4f82-a322-a9690129033e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1809 microversion: 2.20 time: 0.171415 Nov 23 09:02:21.105931 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 306/614] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:02:20 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:02:21.242363 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-4ac04b2a-111c-4633-abac-fefec74e0f7e tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:21.250740 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-4ac04b2a-111c-4633-abac-fefec74e0f7e tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22" status: 200 len: 1266 microversion: 2.1 time: 0.175979 Nov 23 09:02:21.251506 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 309/615] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:21 2021] GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:21.596422 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-e91cec19-6d61-4a70-a13e-0b563507f0f8 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-307734153", "imageRef": "18424a16-ac32-42d5-8161-d6cb36423de3", "flavorRef": "452", "networks": [{"uuid": "75b297ca-5618-4133-9cc2-b7104abb5885"}]}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:02:21.647888 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.network.neutron [None req-e91cec19-6d61-4a70-a13e-0b563507f0f8 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] validate_networks() for [('75b297ca-5618-4133-9cc2-b7104abb5885', None, None, None, None, None)] {{(pid=116227) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 09:02:22.007534 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.virt.hardware [None req-e91cec19-6d61-4a70-a13e-0b563507f0f8 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Flavor limits 0:0:0 {{(pid=116227) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 09:02:22.008160 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.virt.hardware [None req-e91cec19-6d61-4a70-a13e-0b563507f0f8 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Image limits 0:0:0 {{(pid=116227) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 09:02:22.009467 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.virt.hardware [None req-e91cec19-6d61-4a70-a13e-0b563507f0f8 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Flavor pref 0:0:0 {{(pid=116227) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 09:02:22.009899 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.virt.hardware [None req-e91cec19-6d61-4a70-a13e-0b563507f0f8 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Image pref 0:0:0 {{(pid=116227) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 09:02:22.010310 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.virt.hardware [None req-e91cec19-6d61-4a70-a13e-0b563507f0f8 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116227) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 09:02:22.020981 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e91cec19-6d61-4a70-a13e-0b563507f0f8 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:22.021431 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e91cec19-6d61-4a70-a13e-0b563507f0f8 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:22.022248 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e91cec19-6d61-4a70-a13e-0b563507f0f8 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:22.022687 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e91cec19-6d61-4a70-a13e-0b563507f0f8 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:22.039213 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.quota [None req-e91cec19-6d61-4a70-a13e-0b563507f0f8 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Getting quotas for project d6bee9dbebd64795afb8d03d5204db6a. Resources: {'instances', 'ram', 'cores'} {{(pid=116227) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 09:02:22.043373 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.quota [None req-e91cec19-6d61-4a70-a13e-0b563507f0f8 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Getting quotas for user d28c15b0f0444539936252906707a4b5 and project d6bee9dbebd64795afb8d03d5204db6a. Resources: {'instances', 'ram', 'cores'} {{(pid=116227) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 09:02:22.056163 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-e91cec19-6d61-4a70-a13e-0b563507f0f8 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Going to run 1 instances... {{(pid=116227) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 09:02:22.058721 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-e91cec19-6d61-4a70-a13e-0b563507f0f8 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: ef51bee8-a04b-4524-b851-142ac2b803ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='18424a16-ac32-42d5-8161-d6cb36423de3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116227) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 09:02:22.108865 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-e91cec19-6d61-4a70-a13e-0b563507f0f8 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.516110 Nov 23 09:02:22.109895 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 307/616] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 23 09:02:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 09:02:22.120412 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-74aca6fb-23c0-4e44-92ac-8e33f1dbe52c tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:22.121129 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-74aca6fb-23c0-4e44-92ac-8e33f1dbe52c tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: ef51bee8-a04b-4524-b851-142ac2b803ef] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:22.128175 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d278ad6f-e7e0-4a39-b53e-f25d9c326862 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:22.130735 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d278ad6f-e7e0-4a39-b53e-f25d9c326862 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:22.145525 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d278ad6f-e7e0-4a39-b53e-f25d9c326862 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:22.146100 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d278ad6f-e7e0-4a39-b53e-f25d9c326862 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:22.147016 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d278ad6f-e7e0-4a39-b53e-f25d9c326862 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:22.147479 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d278ad6f-e7e0-4a39-b53e-f25d9c326862 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:22.187961 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-74aca6fb-23c0-4e44-92ac-8e33f1dbe52c tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c15b0f0444539936252906707a4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bee9dbebd64795afb8d03d5204db6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:22.194538 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-74aca6fb-23c0-4e44-92ac-8e33f1dbe52c tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef" status: 200 len: 1213 microversion: 2.1 time: 0.078562 Nov 23 09:02:22.195148 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 308/617] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:22 2021] GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:22.267901 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-ca393bc7-7eaa-4e41-a34e-782851cefd5a tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:22.268991 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-ca393bc7-7eaa-4e41-a34e-782851cefd5a tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:22.276210 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ca393bc7-7eaa-4e41-a34e-782851cefd5a tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:22.276527 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ca393bc7-7eaa-4e41-a34e-782851cefd5a tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:22.277368 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ca393bc7-7eaa-4e41-a34e-782851cefd5a tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:22.277842 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ca393bc7-7eaa-4e41-a34e-782851cefd5a tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:22.304676 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d278ad6f-e7e0-4a39-b53e-f25d9c326862 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:22.314244 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d278ad6f-e7e0-4a39-b53e-f25d9c326862 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:22.315760 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d278ad6f-e7e0-4a39-b53e-f25d9c326862 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:22.317218 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d278ad6f-e7e0-4a39-b53e-f25d9c326862 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1796 microversion: 2.20 time: 0.208235 Nov 23 09:02:22.318078 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 310/618] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:02:22 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1796 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:02:22.416471 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-ca393bc7-7eaa-4e41-a34e-782851cefd5a tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:22.424226 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-ca393bc7-7eaa-4e41-a34e-782851cefd5a tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22" status: 200 len: 1266 microversion: 2.1 time: 0.160186 Nov 23 09:02:22.424813 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 309/619] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:22 2021] GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:02:23.211467 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-047d6edb-d513-442e-b0f7-0546ef02a0db tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:23.212192 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-047d6edb-d513-442e-b0f7-0546ef02a0db tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: ef51bee8-a04b-4524-b851-142ac2b803ef] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:23.219013 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-047d6edb-d513-442e-b0f7-0546ef02a0db tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:23.219463 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-047d6edb-d513-442e-b0f7-0546ef02a0db tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:23.220280 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-047d6edb-d513-442e-b0f7-0546ef02a0db tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:23.220692 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-047d6edb-d513-442e-b0f7-0546ef02a0db tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:23.279277 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-047d6edb-d513-442e-b0f7-0546ef02a0db tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c15b0f0444539936252906707a4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bee9dbebd64795afb8d03d5204db6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:23.286486 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-047d6edb-d513-442e-b0f7-0546ef02a0db tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef" status: 200 len: 1217 microversion: 2.1 time: 0.078691 Nov 23 09:02:23.287159 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 311/620] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:23 2021] GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef => generated 1217 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:23.441853 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-8089650d-fb7b-42c9-b58e-3e48da5f30b5 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:23.442379 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-8089650d-fb7b-42c9-b58e-3e48da5f30b5 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:23.449074 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8089650d-fb7b-42c9-b58e-3e48da5f30b5 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:23.449552 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8089650d-fb7b-42c9-b58e-3e48da5f30b5 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:23.450330 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8089650d-fb7b-42c9-b58e-3e48da5f30b5 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:23.450768 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8089650d-fb7b-42c9-b58e-3e48da5f30b5 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:23.580912 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-8089650d-fb7b-42c9-b58e-3e48da5f30b5 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:23.588866 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-8089650d-fb7b-42c9-b58e-3e48da5f30b5 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22" status: 200 len: 1266 microversion: 2.1 time: 0.150753 Nov 23 09:02:23.589471 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 310/621] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:23 2021] GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:24.304489 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-174c8fcc-075a-4f0a-bcbb-2486a3b89544 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:24.305092 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-174c8fcc-075a-4f0a-bcbb-2486a3b89544 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: ef51bee8-a04b-4524-b851-142ac2b803ef] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:24.312170 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-174c8fcc-075a-4f0a-bcbb-2486a3b89544 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:24.312622 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-174c8fcc-075a-4f0a-bcbb-2486a3b89544 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:24.313428 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-174c8fcc-075a-4f0a-bcbb-2486a3b89544 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:24.313865 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-174c8fcc-075a-4f0a-bcbb-2486a3b89544 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:24.373388 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-174c8fcc-075a-4f0a-bcbb-2486a3b89544 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c15b0f0444539936252906707a4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bee9dbebd64795afb8d03d5204db6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:24.380541 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-174c8fcc-075a-4f0a-bcbb-2486a3b89544 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef" status: 200 len: 1209 microversion: 2.1 time: 0.079934 Nov 23 09:02:24.381103 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 312/622] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:24 2021] GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef => generated 1209 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:24.605923 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-5ea99e3f-32b1-43cd-81a3-7a7267892fba tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:24.606439 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-5ea99e3f-32b1-43cd-81a3-7a7267892fba tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:24.612688 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5ea99e3f-32b1-43cd-81a3-7a7267892fba tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:24.613194 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5ea99e3f-32b1-43cd-81a3-7a7267892fba tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:24.613953 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5ea99e3f-32b1-43cd-81a3-7a7267892fba tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:24.614390 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5ea99e3f-32b1-43cd-81a3-7a7267892fba tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:24.745516 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-5ea99e3f-32b1-43cd-81a3-7a7267892fba tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:24.752779 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-5ea99e3f-32b1-43cd-81a3-7a7267892fba tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22" status: 200 len: 1266 microversion: 2.1 time: 0.150691 Nov 23 09:02:24.753521 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 311/623] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:24 2021] GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:25.397959 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c9ca411e-1488-41d9-a09a-ddab6a371585 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:25.398558 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c9ca411e-1488-41d9-a09a-ddab6a371585 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: ef51bee8-a04b-4524-b851-142ac2b803ef] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:25.404937 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c9ca411e-1488-41d9-a09a-ddab6a371585 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:25.405425 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c9ca411e-1488-41d9-a09a-ddab6a371585 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:25.406236 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c9ca411e-1488-41d9-a09a-ddab6a371585 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:25.406690 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c9ca411e-1488-41d9-a09a-ddab6a371585 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:25.500498 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-c9ca411e-1488-41d9-a09a-ddab6a371585 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c15b0f0444539936252906707a4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bee9dbebd64795afb8d03d5204db6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:25.508240 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c9ca411e-1488-41d9-a09a-ddab6a371585 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef" status: 200 len: 1265 microversion: 2.1 time: 0.113879 Nov 23 09:02:25.509983 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 313/624] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:25 2021] GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef => generated 1265 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:25.770089 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-12175f96-1b30-4121-a6ab-833950722bfb tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:25.770693 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-12175f96-1b30-4121-a6ab-833950722bfb tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:25.778369 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-12175f96-1b30-4121-a6ab-833950722bfb tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:25.778650 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-12175f96-1b30-4121-a6ab-833950722bfb tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:25.779444 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-12175f96-1b30-4121-a6ab-833950722bfb tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:25.780154 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-12175f96-1b30-4121-a6ab-833950722bfb tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:26.011377 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-12175f96-1b30-4121-a6ab-833950722bfb tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:26.019481 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-12175f96-1b30-4121-a6ab-833950722bfb tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22" status: 200 len: 1266 microversion: 2.1 time: 0.252856 Nov 23 09:02:26.020180 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 312/625] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:25 2021] GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:26.527455 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-58a51f48-ccfe-427f-a400-5ea6578cda9b tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:26.528767 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-58a51f48-ccfe-427f-a400-5ea6578cda9b tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: ef51bee8-a04b-4524-b851-142ac2b803ef] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:26.537795 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-58a51f48-ccfe-427f-a400-5ea6578cda9b tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:26.538245 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-58a51f48-ccfe-427f-a400-5ea6578cda9b tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:26.539195 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-58a51f48-ccfe-427f-a400-5ea6578cda9b tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:26.540002 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-58a51f48-ccfe-427f-a400-5ea6578cda9b tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:26.688282 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-58a51f48-ccfe-427f-a400-5ea6578cda9b tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c15b0f0444539936252906707a4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bee9dbebd64795afb8d03d5204db6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:26.695608 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-58a51f48-ccfe-427f-a400-5ea6578cda9b tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef" status: 200 len: 1313 microversion: 2.1 time: 0.173752 Nov 23 09:02:26.696969 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 314/626] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:26 2021] GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:27.037883 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-055fe1e6-c739-4f27-91eb-6a76325f4380 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:27.038488 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-055fe1e6-c739-4f27-91eb-6a76325f4380 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:27.045777 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-055fe1e6-c739-4f27-91eb-6a76325f4380 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:27.046223 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-055fe1e6-c739-4f27-91eb-6a76325f4380 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:27.046999 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-055fe1e6-c739-4f27-91eb-6a76325f4380 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:27.047432 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-055fe1e6-c739-4f27-91eb-6a76325f4380 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:27.202939 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-dd146050-6541-4525-9b10-98627bc52330 req-ce84f10b-3568-46ce-9655-bd5af35e7889 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef51bee8-a04b-4524-b851-142ac2b803ef", "tag": "143b5298-0b5f-40bb-bb08-3cac47537d57"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:02:27.204508 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:02:27.204508 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 09:02:27.211320 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-dd146050-6541-4525-9b10-98627bc52330 req-ce84f10b-3568-46ce-9655-bd5af35e7889 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:27.211793 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-dd146050-6541-4525-9b10-98627bc52330 req-ce84f10b-3568-46ce-9655-bd5af35e7889 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:27.223761 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-dd146050-6541-4525-9b10-98627bc52330 req-ce84f10b-3568-46ce-9655-bd5af35e7889 service nova] Creating event network-changed:143b5298-0b5f-40bb-bb08-3cac47537d57 for instance ef51bee8-a04b-4524-b851-142ac2b803ef on hv-cinder-76845 Nov 23 09:02:27.229153 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-dd146050-6541-4525-9b10-98627bc52330 req-ce84f10b-3568-46ce-9655-bd5af35e7889 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029761 Nov 23 09:02:27.229779 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 315/627] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:02:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 09:02:27.256665 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-055fe1e6-c739-4f27-91eb-6a76325f4380 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:27.264093 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-055fe1e6-c739-4f27-91eb-6a76325f4380 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22" status: 200 len: 1266 microversion: 2.1 time: 0.229807 Nov 23 09:02:27.264656 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 313/628] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:27 2021] GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:27.714813 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b392e872-8a4f-4b7b-b967-c4425443ee3e tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:27.715752 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b392e872-8a4f-4b7b-b967-c4425443ee3e tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: ef51bee8-a04b-4524-b851-142ac2b803ef] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:27.721677 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b392e872-8a4f-4b7b-b967-c4425443ee3e tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:27.722126 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b392e872-8a4f-4b7b-b967-c4425443ee3e tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:27.722890 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b392e872-8a4f-4b7b-b967-c4425443ee3e tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:27.723321 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b392e872-8a4f-4b7b-b967-c4425443ee3e tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:27.856132 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b392e872-8a4f-4b7b-b967-c4425443ee3e tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c15b0f0444539936252906707a4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bee9dbebd64795afb8d03d5204db6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:27.863577 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b392e872-8a4f-4b7b-b967-c4425443ee3e tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef" status: 200 len: 1313 microversion: 2.1 time: 0.153557 Nov 23 09:02:27.864363 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 316/629] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:27 2021] GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:28.280825 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-0b9ceb50-08dc-4fef-a99e-535d9ec55dcc tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:28.281423 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-0b9ceb50-08dc-4fef-a99e-535d9ec55dcc tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:28.287698 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0b9ceb50-08dc-4fef-a99e-535d9ec55dcc tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:28.288154 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0b9ceb50-08dc-4fef-a99e-535d9ec55dcc tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:28.288939 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0b9ceb50-08dc-4fef-a99e-535d9ec55dcc tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:28.289412 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0b9ceb50-08dc-4fef-a99e-535d9ec55dcc tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:28.419015 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-0b9ceb50-08dc-4fef-a99e-535d9ec55dcc tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:28.426186 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-0b9ceb50-08dc-4fef-a99e-535d9ec55dcc tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22" status: 200 len: 1266 microversion: 2.1 time: 0.149055 Nov 23 09:02:28.426751 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 314/630] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:28 2021] GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:28.779150 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-be0aecf5-63ea-4f4c-94ef-4fd755cf55a9 req-9e7d1678-cb24-43e4-9bed-033a7af89cae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fcc9f31-a3b6-4476-9c2f-6b22faa98e22", "name": "network-vif-plugged", "status": "completed", "tag": "51572632-a474-4f0a-8d0a-5d7f7a5f7e61"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:02:28.780766 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:02:28.780766 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 09:02:28.789048 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-be0aecf5-63ea-4f4c-94ef-4fd755cf55a9 req-9e7d1678-cb24-43e4-9bed-033a7af89cae service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:28.790298 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-be0aecf5-63ea-4f4c-94ef-4fd755cf55a9 req-9e7d1678-cb24-43e4-9bed-033a7af89cae service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:28.801805 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-be0aecf5-63ea-4f4c-94ef-4fd755cf55a9 req-9e7d1678-cb24-43e4-9bed-033a7af89cae service nova] Creating event network-vif-plugged:51572632-a474-4f0a-8d0a-5d7f7a5f7e61 for instance 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 on hv-cinder-76845 Nov 23 09:02:28.806672 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-be0aecf5-63ea-4f4c-94ef-4fd755cf55a9 req-9e7d1678-cb24-43e4-9bed-033a7af89cae service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031085 Nov 23 09:02:28.807264 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 317/631] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:02:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:02:28.880159 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-33b06fb7-3c8d-4ecd-9fc9-419db31f1184 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:28.880720 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-33b06fb7-3c8d-4ecd-9fc9-419db31f1184 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: ef51bee8-a04b-4524-b851-142ac2b803ef] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:28.887191 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-33b06fb7-3c8d-4ecd-9fc9-419db31f1184 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:28.887646 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-33b06fb7-3c8d-4ecd-9fc9-419db31f1184 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:28.888462 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-33b06fb7-3c8d-4ecd-9fc9-419db31f1184 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:28.888908 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-33b06fb7-3c8d-4ecd-9fc9-419db31f1184 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:29.021914 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-33b06fb7-3c8d-4ecd-9fc9-419db31f1184 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c15b0f0444539936252906707a4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bee9dbebd64795afb8d03d5204db6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:29.029958 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-33b06fb7-3c8d-4ecd-9fc9-419db31f1184 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef" status: 200 len: 1313 microversion: 2.1 time: 0.153457 Nov 23 09:02:29.030541 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 315/632] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:28 2021] GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:29.443626 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-80cae3ec-d0fb-4e6d-9bce-e24d2a273cb0 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:29.444317 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-80cae3ec-d0fb-4e6d-9bce-e24d2a273cb0 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:29.450677 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-80cae3ec-d0fb-4e6d-9bce-e24d2a273cb0 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:29.451128 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-80cae3ec-d0fb-4e6d-9bce-e24d2a273cb0 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:29.451907 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-80cae3ec-d0fb-4e6d-9bce-e24d2a273cb0 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:29.452342 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-80cae3ec-d0fb-4e6d-9bce-e24d2a273cb0 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:29.589529 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-80cae3ec-d0fb-4e6d-9bce-e24d2a273cb0 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:29.597308 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-80cae3ec-d0fb-4e6d-9bce-e24d2a273cb0 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22" status: 200 len: 1266 microversion: 2.1 time: 0.157571 Nov 23 09:02:29.597890 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 318/633] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:29 2021] GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:30.046775 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-13a2bc59-6477-48d2-a09d-f5ab62e9af70 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:30.047385 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-13a2bc59-6477-48d2-a09d-f5ab62e9af70 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: ef51bee8-a04b-4524-b851-142ac2b803ef] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:30.053846 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-13a2bc59-6477-48d2-a09d-f5ab62e9af70 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:30.054299 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-13a2bc59-6477-48d2-a09d-f5ab62e9af70 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:30.055077 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-13a2bc59-6477-48d2-a09d-f5ab62e9af70 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:30.056129 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-13a2bc59-6477-48d2-a09d-f5ab62e9af70 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:30.279690 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-13a2bc59-6477-48d2-a09d-f5ab62e9af70 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c15b0f0444539936252906707a4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bee9dbebd64795afb8d03d5204db6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:30.286988 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-13a2bc59-6477-48d2-a09d-f5ab62e9af70 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef" status: 200 len: 1313 microversion: 2.1 time: 0.243907 Nov 23 09:02:30.287512 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 316/634] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:30 2021] GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef => generated 1313 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:02:30.614558 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-477fb740-8312-440c-ba8e-cdd4c9384605 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:30.615079 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-477fb740-8312-440c-ba8e-cdd4c9384605 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:30.621633 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-477fb740-8312-440c-ba8e-cdd4c9384605 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:30.622107 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-477fb740-8312-440c-ba8e-cdd4c9384605 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:30.622869 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-477fb740-8312-440c-ba8e-cdd4c9384605 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:30.623309 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-477fb740-8312-440c-ba8e-cdd4c9384605 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:30.761554 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-477fb740-8312-440c-ba8e-cdd4c9384605 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:30.768880 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-477fb740-8312-440c-ba8e-cdd4c9384605 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22" status: 200 len: 1266 microversion: 2.1 time: 0.158037 Nov 23 09:02:30.769493 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 319/635] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:30 2021] GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:31.304831 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-c4ff7346-6f0a-42e7-a16b-a725620922cc tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:31.305490 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-c4ff7346-6f0a-42e7-a16b-a725620922cc tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: ef51bee8-a04b-4524-b851-142ac2b803ef] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:31.311731 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c4ff7346-6f0a-42e7-a16b-a725620922cc tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:31.312181 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c4ff7346-6f0a-42e7-a16b-a725620922cc tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:31.312951 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c4ff7346-6f0a-42e7-a16b-a725620922cc tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:31.313418 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c4ff7346-6f0a-42e7-a16b-a725620922cc tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:31.450920 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-c4ff7346-6f0a-42e7-a16b-a725620922cc tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c15b0f0444539936252906707a4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bee9dbebd64795afb8d03d5204db6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:31.461775 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-c4ff7346-6f0a-42e7-a16b-a725620922cc tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef" status: 200 len: 1313 microversion: 2.1 time: 0.160560 Nov 23 09:02:31.462544 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 317/636] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:31 2021] GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:31.786233 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d15f3282-94d5-41aa-b2bf-0e72087f86a8 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:31.786834 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d15f3282-94d5-41aa-b2bf-0e72087f86a8 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:31.793257 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d15f3282-94d5-41aa-b2bf-0e72087f86a8 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:31.793710 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d15f3282-94d5-41aa-b2bf-0e72087f86a8 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:31.794476 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d15f3282-94d5-41aa-b2bf-0e72087f86a8 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:31.794907 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d15f3282-94d5-41aa-b2bf-0e72087f86a8 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:31.925849 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d15f3282-94d5-41aa-b2bf-0e72087f86a8 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:31.933842 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d15f3282-94d5-41aa-b2bf-0e72087f86a8 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22" status: 200 len: 1454 microversion: 2.1 time: 0.151166 Nov 23 09:02:31.934346 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 320/637] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:31 2021] GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:31.951039 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-53a00c9e-8b7b-4d22-ba28-a155ce31ecdb tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:31.951652 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-53a00c9e-8b7b-4d22-ba28-a155ce31ecdb tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:31.957447 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-53a00c9e-8b7b-4d22-ba28-a155ce31ecdb tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:31.957901 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-53a00c9e-8b7b-4d22-ba28-a155ce31ecdb tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:31.958700 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-53a00c9e-8b7b-4d22-ba28-a155ce31ecdb tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:31.959138 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-53a00c9e-8b7b-4d22-ba28-a155ce31ecdb tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:32.096021 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-53a00c9e-8b7b-4d22-ba28-a155ce31ecdb tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:32.104596 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-53a00c9e-8b7b-4d22-ba28-a155ce31ecdb tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22" status: 200 len: 1454 microversion: 2.1 time: 0.157292 Nov 23 09:02:32.105445 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 318/638] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:31 2021] GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:32.481264 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-3da32337-f39c-4e36-a655-8325ffb6ca77 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:32.481804 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-3da32337-f39c-4e36-a655-8325ffb6ca77 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: ef51bee8-a04b-4524-b851-142ac2b803ef] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:32.487709 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3da32337-f39c-4e36-a655-8325ffb6ca77 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:32.488174 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3da32337-f39c-4e36-a655-8325ffb6ca77 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:32.488957 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3da32337-f39c-4e36-a655-8325ffb6ca77 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:32.489416 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3da32337-f39c-4e36-a655-8325ffb6ca77 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:32.630381 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-3da32337-f39c-4e36-a655-8325ffb6ca77 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c15b0f0444539936252906707a4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bee9dbebd64795afb8d03d5204db6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:32.638403 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-3da32337-f39c-4e36-a655-8325ffb6ca77 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef" status: 200 len: 1313 microversion: 2.1 time: 0.161544 Nov 23 09:02:32.639071 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 321/639] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:32 2021] GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:33.655813 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-42847476-8398-4079-9409-65ff5d712f01 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:33.656366 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-42847476-8398-4079-9409-65ff5d712f01 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: ef51bee8-a04b-4524-b851-142ac2b803ef] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:33.662830 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-42847476-8398-4079-9409-65ff5d712f01 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:33.663281 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-42847476-8398-4079-9409-65ff5d712f01 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:33.664069 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-42847476-8398-4079-9409-65ff5d712f01 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:33.665318 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-42847476-8398-4079-9409-65ff5d712f01 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:33.912590 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-42847476-8398-4079-9409-65ff5d712f01 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c15b0f0444539936252906707a4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bee9dbebd64795afb8d03d5204db6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:33.921478 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-42847476-8398-4079-9409-65ff5d712f01 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef" status: 200 len: 1313 microversion: 2.1 time: 0.269325 Nov 23 09:02:33.922378 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 319/640] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:33 2021] GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:34.145637 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-e2a39cbb-c7c2-455e-91b7-5bd263e50f5b req-0239603a-6209-4fef-83b7-8016cf256ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fcc9f31-a3b6-4476-9c2f-6b22faa98e22", "tag": "51572632-a474-4f0a-8d0a-5d7f7a5f7e61"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:02:34.147696 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:02:34.147696 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 09:02:34.155152 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-e2a39cbb-c7c2-455e-91b7-5bd263e50f5b req-0239603a-6209-4fef-83b7-8016cf256ca1 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:34.155596 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-e2a39cbb-c7c2-455e-91b7-5bd263e50f5b req-0239603a-6209-4fef-83b7-8016cf256ca1 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:34.166951 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-e2a39cbb-c7c2-455e-91b7-5bd263e50f5b req-0239603a-6209-4fef-83b7-8016cf256ca1 service nova] Creating event network-changed:51572632-a474-4f0a-8d0a-5d7f7a5f7e61 for instance 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 on hv-cinder-76845 Nov 23 09:02:34.171928 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-e2a39cbb-c7c2-455e-91b7-5bd263e50f5b req-0239603a-6209-4fef-83b7-8016cf256ca1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029828 Nov 23 09:02:34.172566 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 322/641] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:02:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:02:34.937909 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-9c58fd40-7163-4dce-af60-f7050136e8f3 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:34.938515 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-9c58fd40-7163-4dce-af60-f7050136e8f3 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: ef51bee8-a04b-4524-b851-142ac2b803ef] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:34.944919 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9c58fd40-7163-4dce-af60-f7050136e8f3 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:34.945411 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9c58fd40-7163-4dce-af60-f7050136e8f3 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:34.946227 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9c58fd40-7163-4dce-af60-f7050136e8f3 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:34.946659 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9c58fd40-7163-4dce-af60-f7050136e8f3 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:35.083263 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-9c58fd40-7163-4dce-af60-f7050136e8f3 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c15b0f0444539936252906707a4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bee9dbebd64795afb8d03d5204db6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:35.091745 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-9c58fd40-7163-4dce-af60-f7050136e8f3 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef" status: 200 len: 1313 microversion: 2.1 time: 0.157679 Nov 23 09:02:35.092734 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 320/642] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:34 2021] GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:36.110255 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d10f2204-fa22-4cab-8a8a-7fbe7dc068da tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:36.110980 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d10f2204-fa22-4cab-8a8a-7fbe7dc068da tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: ef51bee8-a04b-4524-b851-142ac2b803ef] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:36.116972 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d10f2204-fa22-4cab-8a8a-7fbe7dc068da tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:36.118093 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d10f2204-fa22-4cab-8a8a-7fbe7dc068da tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:36.118872 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d10f2204-fa22-4cab-8a8a-7fbe7dc068da tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:36.119307 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d10f2204-fa22-4cab-8a8a-7fbe7dc068da tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:36.265754 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d10f2204-fa22-4cab-8a8a-7fbe7dc068da tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c15b0f0444539936252906707a4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bee9dbebd64795afb8d03d5204db6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:36.275317 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d10f2204-fa22-4cab-8a8a-7fbe7dc068da tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef" status: 200 len: 1313 microversion: 2.1 time: 0.169225 Nov 23 09:02:36.275908 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 323/643] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:36 2021] GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:37.292780 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-ca3b4cfc-a334-4135-bb55-08f171208fd3 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:37.293339 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-ca3b4cfc-a334-4135-bb55-08f171208fd3 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: ef51bee8-a04b-4524-b851-142ac2b803ef] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:37.299882 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ca3b4cfc-a334-4135-bb55-08f171208fd3 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:37.300639 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ca3b4cfc-a334-4135-bb55-08f171208fd3 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:37.301728 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ca3b4cfc-a334-4135-bb55-08f171208fd3 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:37.302160 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ca3b4cfc-a334-4135-bb55-08f171208fd3 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:37.440136 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-ca3b4cfc-a334-4135-bb55-08f171208fd3 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c15b0f0444539936252906707a4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bee9dbebd64795afb8d03d5204db6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:37.447846 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-ca3b4cfc-a334-4135-bb55-08f171208fd3 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef" status: 200 len: 1313 microversion: 2.1 time: 0.159425 Nov 23 09:02:37.448500 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 321/644] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:37 2021] GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:38.464499 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-96ecc54f-3fba-4814-b136-3ec435afdb49 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:38.465300 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-96ecc54f-3fba-4814-b136-3ec435afdb49 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: ef51bee8-a04b-4524-b851-142ac2b803ef] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:38.471531 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-96ecc54f-3fba-4814-b136-3ec435afdb49 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:38.471986 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-96ecc54f-3fba-4814-b136-3ec435afdb49 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:38.472759 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-96ecc54f-3fba-4814-b136-3ec435afdb49 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:38.473221 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-96ecc54f-3fba-4814-b136-3ec435afdb49 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:38.613869 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-96ecc54f-3fba-4814-b136-3ec435afdb49 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c15b0f0444539936252906707a4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bee9dbebd64795afb8d03d5204db6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:38.625963 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-96ecc54f-3fba-4814-b136-3ec435afdb49 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef" status: 200 len: 1313 microversion: 2.1 time: 0.164959 Nov 23 09:02:38.626602 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 324/645] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:38 2021] GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:38.997201 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-7dcc5013-60d7-4dc5-bf04-03f28c4bb046 req-cc29f68e-b533-4f1e-9e61-6ca715a52f20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef51bee8-a04b-4524-b851-142ac2b803ef", "name": "network-vif-plugged", "status": "completed", "tag": "143b5298-0b5f-40bb-bb08-3cac47537d57"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:02:38.998831 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:02:38.998831 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 09:02:39.006213 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-7dcc5013-60d7-4dc5-bf04-03f28c4bb046 req-cc29f68e-b533-4f1e-9e61-6ca715a52f20 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:39.006611 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-7dcc5013-60d7-4dc5-bf04-03f28c4bb046 req-cc29f68e-b533-4f1e-9e61-6ca715a52f20 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:39.020235 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-7dcc5013-60d7-4dc5-bf04-03f28c4bb046 req-cc29f68e-b533-4f1e-9e61-6ca715a52f20 service nova] Creating event network-vif-plugged:143b5298-0b5f-40bb-bb08-3cac47537d57 for instance ef51bee8-a04b-4524-b851-142ac2b803ef on hv-cinder-76845 Nov 23 09:02:39.026251 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-7dcc5013-60d7-4dc5-bf04-03f28c4bb046 req-cc29f68e-b533-4f1e-9e61-6ca715a52f20 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032609 Nov 23 09:02:39.026939 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 322/646] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:02:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:02:39.643494 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-6059e7e1-e2bb-41f1-b85f-75f4c2523055 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:39.644124 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-6059e7e1-e2bb-41f1-b85f-75f4c2523055 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: ef51bee8-a04b-4524-b851-142ac2b803ef] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:39.650726 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6059e7e1-e2bb-41f1-b85f-75f4c2523055 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:39.651171 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6059e7e1-e2bb-41f1-b85f-75f4c2523055 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:39.651938 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6059e7e1-e2bb-41f1-b85f-75f4c2523055 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:39.652369 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6059e7e1-e2bb-41f1-b85f-75f4c2523055 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:39.784178 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-6059e7e1-e2bb-41f1-b85f-75f4c2523055 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c15b0f0444539936252906707a4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bee9dbebd64795afb8d03d5204db6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:39.791602 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-6059e7e1-e2bb-41f1-b85f-75f4c2523055 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef" status: 200 len: 1313 microversion: 2.1 time: 0.151677 Nov 23 09:02:39.792179 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 325/647] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:39 2021] GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:40.812700 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-2846fb15-4fbb-4193-ae89-6ca40fe7f5a7 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:40.813426 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-2846fb15-4fbb-4193-ae89-6ca40fe7f5a7 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: ef51bee8-a04b-4524-b851-142ac2b803ef] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:40.819526 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2846fb15-4fbb-4193-ae89-6ca40fe7f5a7 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:40.819978 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2846fb15-4fbb-4193-ae89-6ca40fe7f5a7 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:40.821436 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2846fb15-4fbb-4193-ae89-6ca40fe7f5a7 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:40.821903 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2846fb15-4fbb-4193-ae89-6ca40fe7f5a7 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:40.982843 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-2846fb15-4fbb-4193-ae89-6ca40fe7f5a7 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c15b0f0444539936252906707a4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bee9dbebd64795afb8d03d5204db6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:40.989978 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-2846fb15-4fbb-4193-ae89-6ca40fe7f5a7 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef" status: 200 len: 1313 microversion: 2.1 time: 0.181804 Nov 23 09:02:40.990549 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 323/648] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:40 2021] GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:42.007159 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-2a6a1b72-8fa2-4b5d-90bc-eaf23c617298 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:42.007731 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-2a6a1b72-8fa2-4b5d-90bc-eaf23c617298 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: ef51bee8-a04b-4524-b851-142ac2b803ef] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:42.013770 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2a6a1b72-8fa2-4b5d-90bc-eaf23c617298 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:42.014230 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2a6a1b72-8fa2-4b5d-90bc-eaf23c617298 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:42.014987 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2a6a1b72-8fa2-4b5d-90bc-eaf23c617298 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:42.015416 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2a6a1b72-8fa2-4b5d-90bc-eaf23c617298 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:42.167405 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-2a6a1b72-8fa2-4b5d-90bc-eaf23c617298 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c15b0f0444539936252906707a4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bee9dbebd64795afb8d03d5204db6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:42.175626 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-2a6a1b72-8fa2-4b5d-90bc-eaf23c617298 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef" status: 200 len: 1313 microversion: 2.1 time: 0.172058 Nov 23 09:02:42.176366 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 326/649] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:42 2021] GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:43.193471 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-98e52b74-e059-4377-a56d-f34f618f4cd2 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:43.193995 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-98e52b74-e059-4377-a56d-f34f618f4cd2 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: ef51bee8-a04b-4524-b851-142ac2b803ef] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:43.200862 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-98e52b74-e059-4377-a56d-f34f618f4cd2 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:43.201356 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-98e52b74-e059-4377-a56d-f34f618f4cd2 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:43.202140 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-98e52b74-e059-4377-a56d-f34f618f4cd2 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:43.202582 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-98e52b74-e059-4377-a56d-f34f618f4cd2 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:43.334441 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-98e52b74-e059-4377-a56d-f34f618f4cd2 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c15b0f0444539936252906707a4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bee9dbebd64795afb8d03d5204db6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:43.342472 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-98e52b74-e059-4377-a56d-f34f618f4cd2 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef" status: 200 len: 1498 microversion: 2.1 time: 0.152801 Nov 23 09:02:43.343082 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 324/650] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:43 2021] GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef => generated 1498 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:46.708621 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-66ef2bb0-808e-426e-aeb6-828ae7b1966f tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:46.709142 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-66ef2bb0-808e-426e-aeb6-828ae7b1966f tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: ef51bee8-a04b-4524-b851-142ac2b803ef] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:46.716097 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-66ef2bb0-808e-426e-aeb6-828ae7b1966f tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:46.716546 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-66ef2bb0-808e-426e-aeb6-828ae7b1966f tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:46.717364 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-66ef2bb0-808e-426e-aeb6-828ae7b1966f tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:46.717800 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-66ef2bb0-808e-426e-aeb6-828ae7b1966f tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:46.741550 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-66ef2bb0-808e-426e-aeb6-828ae7b1966f tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: ef51bee8-a04b-4524-b851-142ac2b803ef] Going to try to terminate instance {{(pid=116226) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 09:02:46.811958 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-66ef2bb0-808e-426e-aeb6-828ae7b1966f tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef" status: 204 len: 0 microversion: 2.1 time: 0.107069 Nov 23 09:02:46.812544 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 327/651] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 23 09:02:46 2021] DELETE /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 09:02:46.820545 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-0737cb98-6b26-47a7-80e4-ca8e1788b48c tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:46.821389 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-0737cb98-6b26-47a7-80e4-ca8e1788b48c tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: ef51bee8-a04b-4524-b851-142ac2b803ef] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:46.827234 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0737cb98-6b26-47a7-80e4-ca8e1788b48c tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:46.827684 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0737cb98-6b26-47a7-80e4-ca8e1788b48c tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:46.828466 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0737cb98-6b26-47a7-80e4-ca8e1788b48c tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:46.828907 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0737cb98-6b26-47a7-80e4-ca8e1788b48c tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:46.959730 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-0737cb98-6b26-47a7-80e4-ca8e1788b48c tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c15b0f0444539936252906707a4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bee9dbebd64795afb8d03d5204db6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:46.967752 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-0737cb98-6b26-47a7-80e4-ca8e1788b48c tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef" status: 200 len: 1504 microversion: 2.1 time: 0.151053 Nov 23 09:02:46.968316 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 325/652] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:46 2021] GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:47.985940 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a3a34bbc-75bb-47f4-96d4-096f9be4bfce tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:47.986638 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a3a34bbc-75bb-47f4-96d4-096f9be4bfce tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: ef51bee8-a04b-4524-b851-142ac2b803ef] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:47.992925 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a3a34bbc-75bb-47f4-96d4-096f9be4bfce tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:47.993427 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a3a34bbc-75bb-47f4-96d4-096f9be4bfce tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:47.994196 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a3a34bbc-75bb-47f4-96d4-096f9be4bfce tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:47.994637 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a3a34bbc-75bb-47f4-96d4-096f9be4bfce tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:48.127741 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a3a34bbc-75bb-47f4-96d4-096f9be4bfce tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c15b0f0444539936252906707a4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bee9dbebd64795afb8d03d5204db6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:48.135522 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a3a34bbc-75bb-47f4-96d4-096f9be4bfce tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef" status: 200 len: 1504 microversion: 2.1 time: 0.153237 Nov 23 09:02:48.136095 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 328/653] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:47 2021] GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:49.004146 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-62ff4e4c-6419-467c-a2e0-1825637d17f4 req-7cabcd6e-2b1e-4296-b0a6-a984e1d6608b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef51bee8-a04b-4524-b851-142ac2b803ef", "name": "network-vif-deleted", "tag": "143b5298-0b5f-40bb-bb08-3cac47537d57"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:02:49.005661 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:02:49.005661 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 09:02:49.012987 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-62ff4e4c-6419-467c-a2e0-1825637d17f4 req-7cabcd6e-2b1e-4296-b0a6-a984e1d6608b service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:49.013466 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-62ff4e4c-6419-467c-a2e0-1825637d17f4 req-7cabcd6e-2b1e-4296-b0a6-a984e1d6608b service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:49.024958 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-62ff4e4c-6419-467c-a2e0-1825637d17f4 req-7cabcd6e-2b1e-4296-b0a6-a984e1d6608b service nova] Creating event network-vif-deleted:143b5298-0b5f-40bb-bb08-3cac47537d57 for instance ef51bee8-a04b-4524-b851-142ac2b803ef on hv-cinder-76845 Nov 23 09:02:49.030402 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-62ff4e4c-6419-467c-a2e0-1825637d17f4 req-7cabcd6e-2b1e-4296-b0a6-a984e1d6608b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029810 Nov 23 09:02:49.030995 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 326/654] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:02:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:02:49.152079 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-26ee2694-2348-4003-8824-79230fdc8c54 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:49.152663 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-26ee2694-2348-4003-8824-79230fdc8c54 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: ef51bee8-a04b-4524-b851-142ac2b803ef] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:49.158923 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-26ee2694-2348-4003-8824-79230fdc8c54 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:49.159376 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-26ee2694-2348-4003-8824-79230fdc8c54 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:49.160150 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-26ee2694-2348-4003-8824-79230fdc8c54 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:49.160582 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-26ee2694-2348-4003-8824-79230fdc8c54 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:49.193202 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-26ee2694-2348-4003-8824-79230fdc8c54 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:49.193744 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-26ee2694-2348-4003-8824-79230fdc8c54 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:49.194301 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.objects.instance [None req-26ee2694-2348-4003-8824-79230fdc8c54 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lazy-loading 'fault' on Instance uuid ef51bee8-a04b-4524-b851-142ac2b803ef {{(pid=116226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 09:02:49.239104 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-26ee2694-2348-4003-8824-79230fdc8c54 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c15b0f0444539936252906707a4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bee9dbebd64795afb8d03d5204db6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:49.247207 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-26ee2694-2348-4003-8824-79230fdc8c54 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef" status: 200 len: 1303 microversion: 2.1 time: 0.099338 Nov 23 09:02:49.247776 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 329/655] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:49 2021] GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:50.264665 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-f4226e88-4f9a-4b87-9193-d7346442b979 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:50.265399 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-f4226e88-4f9a-4b87-9193-d7346442b979 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: ef51bee8-a04b-4524-b851-142ac2b803ef] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:50.271410 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f4226e88-4f9a-4b87-9193-d7346442b979 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:50.271854 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f4226e88-4f9a-4b87-9193-d7346442b979 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:50.272656 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f4226e88-4f9a-4b87-9193-d7346442b979 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:50.273300 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f4226e88-4f9a-4b87-9193-d7346442b979 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:50.288119 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.wsgi [None req-f4226e88-4f9a-4b87-9193-d7346442b979 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] HTTP exception thrown: Instance ef51bee8-a04b-4524-b851-142ac2b803ef could not be found. Nov 23 09:02:50.289253 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-f4226e88-4f9a-4b87-9193-d7346442b979 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Returning 404 to user: Instance ef51bee8-a04b-4524-b851-142ac2b803ef could not be found. {{(pid=116227) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 09:02:50.290392 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-f4226e88-4f9a-4b87-9193-d7346442b979 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef" status: 404 len: 111 microversion: 2.1 time: 0.029840 Nov 23 09:02:50.290931 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 327/656] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:50 2021] GET /compute/v2.1/servers/ef51bee8-a04b-4524-b851-142ac2b803ef => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 09:02:50.384607 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-2ccb5035-a359-4231-a50b-21a4d8e82b39 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-44148036", "imageRef": "18424a16-ac32-42d5-8161-d6cb36423de3", "flavorRef": "452", "networks": [{"uuid": "75b297ca-5618-4133-9cc2-b7104abb5885"}]}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:02:50.436414 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.network.neutron [None req-2ccb5035-a359-4231-a50b-21a4d8e82b39 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] validate_networks() for [('75b297ca-5618-4133-9cc2-b7104abb5885', None, None, None, None, None)] {{(pid=116226) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 09:02:50.773744 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-2ccb5035-a359-4231-a50b-21a4d8e82b39 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Flavor limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 09:02:50.774198 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-2ccb5035-a359-4231-a50b-21a4d8e82b39 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Image limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 09:02:50.774671 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-2ccb5035-a359-4231-a50b-21a4d8e82b39 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Flavor pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 09:02:50.775081 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-2ccb5035-a359-4231-a50b-21a4d8e82b39 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Image pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 09:02:50.775492 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-2ccb5035-a359-4231-a50b-21a4d8e82b39 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 09:02:50.784375 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2ccb5035-a359-4231-a50b-21a4d8e82b39 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:50.784825 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2ccb5035-a359-4231-a50b-21a4d8e82b39 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:50.785682 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2ccb5035-a359-4231-a50b-21a4d8e82b39 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:50.786116 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2ccb5035-a359-4231-a50b-21a4d8e82b39 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:50.802296 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-2ccb5035-a359-4231-a50b-21a4d8e82b39 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Getting quotas for project d6bee9dbebd64795afb8d03d5204db6a. Resources: {'instances', 'ram', 'cores'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 09:02:50.806236 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-2ccb5035-a359-4231-a50b-21a4d8e82b39 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Getting quotas for user d28c15b0f0444539936252906707a4b5 and project d6bee9dbebd64795afb8d03d5204db6a. Resources: {'instances', 'ram', 'cores'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 09:02:50.816682 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-2ccb5035-a359-4231-a50b-21a4d8e82b39 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Going to run 1 instances... {{(pid=116226) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 09:02:50.818962 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-2ccb5035-a359-4231-a50b-21a4d8e82b39 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: c4ee21e5-f99f-4c3f-a988-8304f8910950] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='18424a16-ac32-42d5-8161-d6cb36423de3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116226) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 09:02:50.863780 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-2ccb5035-a359-4231-a50b-21a4d8e82b39 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.483018 Nov 23 09:02:50.864619 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 330/657] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 23 09:02:50 2021] POST /compute/v2.1/servers => generated 380 bytes in 484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 09:02:50.874192 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-781de403-9cfd-4e2b-842a-142e2f56624f tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:50.874803 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-781de403-9cfd-4e2b-842a-142e2f56624f tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: c4ee21e5-f99f-4c3f-a988-8304f8910950] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:50.930376 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-781de403-9cfd-4e2b-842a-142e2f56624f tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c15b0f0444539936252906707a4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bee9dbebd64795afb8d03d5204db6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:50.936997 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-781de403-9cfd-4e2b-842a-142e2f56624f tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "GET /compute/v2.1/servers/c4ee21e5-f99f-4c3f-a988-8304f8910950" status: 200 len: 1212 microversion: 2.1 time: 0.066402 Nov 23 09:02:50.941522 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 328/658] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:50 2021] GET /compute/v2.1/servers/c4ee21e5-f99f-4c3f-a988-8304f8910950 => generated 1212 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:51.956767 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-6a803b85-6cfa-4f41-babd-0104a3733393 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:51.958040 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-6a803b85-6cfa-4f41-babd-0104a3733393 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: c4ee21e5-f99f-4c3f-a988-8304f8910950] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:51.965789 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6a803b85-6cfa-4f41-babd-0104a3733393 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:51.966495 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6a803b85-6cfa-4f41-babd-0104a3733393 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:51.967304 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6a803b85-6cfa-4f41-babd-0104a3733393 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:51.967741 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6a803b85-6cfa-4f41-babd-0104a3733393 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:52.033989 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-6a803b85-6cfa-4f41-babd-0104a3733393 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c15b0f0444539936252906707a4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bee9dbebd64795afb8d03d5204db6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:52.042422 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-6a803b85-6cfa-4f41-babd-0104a3733393 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "GET /compute/v2.1/servers/c4ee21e5-f99f-4c3f-a988-8304f8910950" status: 200 len: 1282 microversion: 2.1 time: 0.090979 Nov 23 09:02:52.042987 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 331/659] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:51 2021] GET /compute/v2.1/servers/c4ee21e5-f99f-4c3f-a988-8304f8910950 => generated 1282 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:53.060385 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-ee264e01-5266-44c8-b8b1-fcf83d4c3bbb tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:53.061185 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-ee264e01-5266-44c8-b8b1-fcf83d4c3bbb tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: c4ee21e5-f99f-4c3f-a988-8304f8910950] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:53.068564 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ee264e01-5266-44c8-b8b1-fcf83d4c3bbb tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:53.069064 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ee264e01-5266-44c8-b8b1-fcf83d4c3bbb tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:53.070211 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ee264e01-5266-44c8-b8b1-fcf83d4c3bbb tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:53.070852 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ee264e01-5266-44c8-b8b1-fcf83d4c3bbb tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:53.286985 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-ee264e01-5266-44c8-b8b1-fcf83d4c3bbb tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c15b0f0444539936252906707a4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bee9dbebd64795afb8d03d5204db6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:53.295678 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-ee264e01-5266-44c8-b8b1-fcf83d4c3bbb tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "GET /compute/v2.1/servers/c4ee21e5-f99f-4c3f-a988-8304f8910950" status: 200 len: 1312 microversion: 2.1 time: 0.238948 Nov 23 09:02:53.296439 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 329/660] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:53 2021] GET /compute/v2.1/servers/c4ee21e5-f99f-4c3f-a988-8304f8910950 => generated 1312 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:53.341454 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-843584fc-af12-4fe0-bfbe-7bcbba204a0e req-ece794e1-9767-4163-b8f9-01031fafbc41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4ee21e5-f99f-4c3f-a988-8304f8910950", "tag": "649f9bb6-ab8a-4281-a990-56b616f8985e"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:02:53.344330 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:02:53.344330 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 09:02:53.353350 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-843584fc-af12-4fe0-bfbe-7bcbba204a0e req-ece794e1-9767-4163-b8f9-01031fafbc41 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:53.353922 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-843584fc-af12-4fe0-bfbe-7bcbba204a0e req-ece794e1-9767-4163-b8f9-01031fafbc41 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:53.365972 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-843584fc-af12-4fe0-bfbe-7bcbba204a0e req-ece794e1-9767-4163-b8f9-01031fafbc41 service nova] Creating event network-changed:649f9bb6-ab8a-4281-a990-56b616f8985e for instance c4ee21e5-f99f-4c3f-a988-8304f8910950 on hv-cinder-76845 Nov 23 09:02:53.371398 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-843584fc-af12-4fe0-bfbe-7bcbba204a0e req-ece794e1-9767-4163-b8f9-01031fafbc41 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035928 Nov 23 09:02:53.372239 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 332/661] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:02:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:02:54.312080 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-50523059-ec44-4d6c-9c0d-f4abc1f016d1 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:54.312789 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-50523059-ec44-4d6c-9c0d-f4abc1f016d1 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: c4ee21e5-f99f-4c3f-a988-8304f8910950] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:54.322156 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-50523059-ec44-4d6c-9c0d-f4abc1f016d1 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:54.322651 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-50523059-ec44-4d6c-9c0d-f4abc1f016d1 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:54.323713 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-50523059-ec44-4d6c-9c0d-f4abc1f016d1 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:54.324271 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-50523059-ec44-4d6c-9c0d-f4abc1f016d1 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:54.469904 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-50523059-ec44-4d6c-9c0d-f4abc1f016d1 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c15b0f0444539936252906707a4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bee9dbebd64795afb8d03d5204db6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:54.477891 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-50523059-ec44-4d6c-9c0d-f4abc1f016d1 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "GET /compute/v2.1/servers/c4ee21e5-f99f-4c3f-a988-8304f8910950" status: 200 len: 1312 microversion: 2.1 time: 0.169939 Nov 23 09:02:54.478498 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 330/662] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:54 2021] GET /compute/v2.1/servers/c4ee21e5-f99f-4c3f-a988-8304f8910950 => generated 1312 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:55.496071 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-0f6833d4-fd87-4f1e-9dda-e93f8f404b6d tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:55.496793 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-0f6833d4-fd87-4f1e-9dda-e93f8f404b6d tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: c4ee21e5-f99f-4c3f-a988-8304f8910950] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:55.502659 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0f6833d4-fd87-4f1e-9dda-e93f8f404b6d tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:55.503114 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0f6833d4-fd87-4f1e-9dda-e93f8f404b6d tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:55.503929 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0f6833d4-fd87-4f1e-9dda-e93f8f404b6d tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:55.504370 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0f6833d4-fd87-4f1e-9dda-e93f8f404b6d tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:55.638746 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-0f6833d4-fd87-4f1e-9dda-e93f8f404b6d tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c15b0f0444539936252906707a4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bee9dbebd64795afb8d03d5204db6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:55.646174 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-0f6833d4-fd87-4f1e-9dda-e93f8f404b6d tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "GET /compute/v2.1/servers/c4ee21e5-f99f-4c3f-a988-8304f8910950" status: 200 len: 1312 microversion: 2.1 time: 0.154749 Nov 23 09:02:55.646733 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 333/663] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:55 2021] GET /compute/v2.1/servers/c4ee21e5-f99f-4c3f-a988-8304f8910950 => generated 1312 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:56.663633 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-8e068d93-00a0-4a55-99c6-9978a7e7c0ef tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:56.664549 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-8e068d93-00a0-4a55-99c6-9978a7e7c0ef tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: c4ee21e5-f99f-4c3f-a988-8304f8910950] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:56.671745 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8e068d93-00a0-4a55-99c6-9978a7e7c0ef tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:56.672207 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8e068d93-00a0-4a55-99c6-9978a7e7c0ef tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:56.673008 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8e068d93-00a0-4a55-99c6-9978a7e7c0ef tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:56.673517 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8e068d93-00a0-4a55-99c6-9978a7e7c0ef tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:56.802987 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-8e068d93-00a0-4a55-99c6-9978a7e7c0ef tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c15b0f0444539936252906707a4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bee9dbebd64795afb8d03d5204db6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:56.810626 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-8e068d93-00a0-4a55-99c6-9978a7e7c0ef tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "GET /compute/v2.1/servers/c4ee21e5-f99f-4c3f-a988-8304f8910950" status: 200 len: 1312 microversion: 2.1 time: 0.150753 Nov 23 09:02:56.811209 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 331/664] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:56 2021] GET /compute/v2.1/servers/c4ee21e5-f99f-4c3f-a988-8304f8910950 => generated 1312 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:57.827803 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-1079ca21-0bdd-4b62-a6c0-0dacb3519038 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:57.828406 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-1079ca21-0bdd-4b62-a6c0-0dacb3519038 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: c4ee21e5-f99f-4c3f-a988-8304f8910950] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:57.834491 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1079ca21-0bdd-4b62-a6c0-0dacb3519038 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:57.834957 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1079ca21-0bdd-4b62-a6c0-0dacb3519038 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:57.836040 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1079ca21-0bdd-4b62-a6c0-0dacb3519038 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:57.836480 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1079ca21-0bdd-4b62-a6c0-0dacb3519038 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:57.963264 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-1079ca21-0bdd-4b62-a6c0-0dacb3519038 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c15b0f0444539936252906707a4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bee9dbebd64795afb8d03d5204db6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:57.970645 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-1079ca21-0bdd-4b62-a6c0-0dacb3519038 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "GET /compute/v2.1/servers/c4ee21e5-f99f-4c3f-a988-8304f8910950" status: 200 len: 1312 microversion: 2.1 time: 0.146715 Nov 23 09:02:57.971205 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 334/665] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:57 2021] GET /compute/v2.1/servers/c4ee21e5-f99f-4c3f-a988-8304f8910950 => generated 1312 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:02:58.595118 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-a355bea5-242c-4f3d-a2f8-096b5cc3c712 req-61258b6f-397b-42e0-8637-c859dfe2dc16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4ee21e5-f99f-4c3f-a988-8304f8910950", "name": "network-vif-plugged", "status": "completed", "tag": "649f9bb6-ab8a-4281-a990-56b616f8985e"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:02:58.596778 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:02:58.596778 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 09:02:58.604717 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-a355bea5-242c-4f3d-a2f8-096b5cc3c712 req-61258b6f-397b-42e0-8637-c859dfe2dc16 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:58.605215 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-a355bea5-242c-4f3d-a2f8-096b5cc3c712 req-61258b6f-397b-42e0-8637-c859dfe2dc16 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:58.615916 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-a355bea5-242c-4f3d-a2f8-096b5cc3c712 req-61258b6f-397b-42e0-8637-c859dfe2dc16 service nova] Creating event network-vif-plugged:649f9bb6-ab8a-4281-a990-56b616f8985e for instance c4ee21e5-f99f-4c3f-a988-8304f8910950 on hv-cinder-76845 Nov 23 09:02:58.621351 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-a355bea5-242c-4f3d-a2f8-096b5cc3c712 req-61258b6f-397b-42e0-8637-c859dfe2dc16 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029923 Nov 23 09:02:58.622184 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 332/666] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:02:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:02:58.987635 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-75c5ae18-8413-42b4-bf3d-0437e97c8643 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:02:58.988247 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-75c5ae18-8413-42b4-bf3d-0437e97c8643 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: c4ee21e5-f99f-4c3f-a988-8304f8910950] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:02:58.994814 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-75c5ae18-8413-42b4-bf3d-0437e97c8643 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:58.995489 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-75c5ae18-8413-42b4-bf3d-0437e97c8643 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:58.996311 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-75c5ae18-8413-42b4-bf3d-0437e97c8643 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:02:58.996751 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-75c5ae18-8413-42b4-bf3d-0437e97c8643 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:02:59.132363 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-75c5ae18-8413-42b4-bf3d-0437e97c8643 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c15b0f0444539936252906707a4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bee9dbebd64795afb8d03d5204db6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:02:59.140222 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-75c5ae18-8413-42b4-bf3d-0437e97c8643 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "GET /compute/v2.1/servers/c4ee21e5-f99f-4c3f-a988-8304f8910950" status: 200 len: 1312 microversion: 2.1 time: 0.156348 Nov 23 09:02:59.140892 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 335/667] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:02:58 2021] GET /compute/v2.1/servers/c4ee21e5-f99f-4c3f-a988-8304f8910950 => generated 1312 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:03:00.158750 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-6264b640-337b-4da8-8fc6-93b434dd10de tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:03:00.159449 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-6264b640-337b-4da8-8fc6-93b434dd10de tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: c4ee21e5-f99f-4c3f-a988-8304f8910950] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:00.165482 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6264b640-337b-4da8-8fc6-93b434dd10de tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:00.165920 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6264b640-337b-4da8-8fc6-93b434dd10de tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:00.166693 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6264b640-337b-4da8-8fc6-93b434dd10de tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:00.167121 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6264b640-337b-4da8-8fc6-93b434dd10de tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:00.302912 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-6264b640-337b-4da8-8fc6-93b434dd10de tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c15b0f0444539936252906707a4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bee9dbebd64795afb8d03d5204db6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:00.310841 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-6264b640-337b-4da8-8fc6-93b434dd10de tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "GET /compute/v2.1/servers/c4ee21e5-f99f-4c3f-a988-8304f8910950" status: 200 len: 1496 microversion: 2.1 time: 0.156719 Nov 23 09:03:00.311506 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 333/668] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:03:00 2021] GET /compute/v2.1/servers/c4ee21e5-f99f-4c3f-a988-8304f8910950 => generated 1496 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:03:00.758223 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-3a682cbb-10bc-47ff-be87-dfde4b20eccd tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:03:00.758881 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-3a682cbb-10bc-47ff-be87-dfde4b20eccd tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: c4ee21e5-f99f-4c3f-a988-8304f8910950] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:00.764958 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3a682cbb-10bc-47ff-be87-dfde4b20eccd tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:00.765448 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3a682cbb-10bc-47ff-be87-dfde4b20eccd tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:00.766266 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3a682cbb-10bc-47ff-be87-dfde4b20eccd tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:00.766643 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3a682cbb-10bc-47ff-be87-dfde4b20eccd tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:00.793574 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-3a682cbb-10bc-47ff-be87-dfde4b20eccd tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: c4ee21e5-f99f-4c3f-a988-8304f8910950] Going to try to terminate instance {{(pid=116226) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 09:03:00.874548 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-3a682cbb-10bc-47ff-be87-dfde4b20eccd tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c4ee21e5-f99f-4c3f-a988-8304f8910950" status: 204 len: 0 microversion: 2.1 time: 0.119644 Nov 23 09:03:00.875992 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 336/669] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 23 09:03:00 2021] DELETE /compute/v2.1/servers/c4ee21e5-f99f-4c3f-a988-8304f8910950 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 09:03:00.884313 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-09898669-ea9c-4cd3-8bfc-b3dc64d9c415 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:03:00.884926 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-09898669-ea9c-4cd3-8bfc-b3dc64d9c415 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: c4ee21e5-f99f-4c3f-a988-8304f8910950] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:00.891037 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-09898669-ea9c-4cd3-8bfc-b3dc64d9c415 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:00.891540 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-09898669-ea9c-4cd3-8bfc-b3dc64d9c415 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:00.892337 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-09898669-ea9c-4cd3-8bfc-b3dc64d9c415 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:00.892775 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-09898669-ea9c-4cd3-8bfc-b3dc64d9c415 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:01.028064 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-09898669-ea9c-4cd3-8bfc-b3dc64d9c415 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c15b0f0444539936252906707a4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bee9dbebd64795afb8d03d5204db6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:01.035303 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-09898669-ea9c-4cd3-8bfc-b3dc64d9c415 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "GET /compute/v2.1/servers/c4ee21e5-f99f-4c3f-a988-8304f8910950" status: 200 len: 1502 microversion: 2.1 time: 0.155263 Nov 23 09:03:01.035869 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 334/670] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:03:00 2021] GET /compute/v2.1/servers/c4ee21e5-f99f-4c3f-a988-8304f8910950 => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:03:02.053146 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-62ac07fe-55b7-45f2-a7e6-9e2e7075a01b tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:03:02.053887 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-62ac07fe-55b7-45f2-a7e6-9e2e7075a01b tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: c4ee21e5-f99f-4c3f-a988-8304f8910950] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:02.068066 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-62ac07fe-55b7-45f2-a7e6-9e2e7075a01b tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:02.068555 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-62ac07fe-55b7-45f2-a7e6-9e2e7075a01b tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:02.069372 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-62ac07fe-55b7-45f2-a7e6-9e2e7075a01b tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:02.071030 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-62ac07fe-55b7-45f2-a7e6-9e2e7075a01b tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:02.205354 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-62ac07fe-55b7-45f2-a7e6-9e2e7075a01b tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c15b0f0444539936252906707a4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bee9dbebd64795afb8d03d5204db6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:02.212911 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-62ac07fe-55b7-45f2-a7e6-9e2e7075a01b tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "GET /compute/v2.1/servers/c4ee21e5-f99f-4c3f-a988-8304f8910950" status: 200 len: 1502 microversion: 2.1 time: 0.164079 Nov 23 09:03:02.213515 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 337/671] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:03:02 2021] GET /compute/v2.1/servers/c4ee21e5-f99f-4c3f-a988-8304f8910950 => generated 1502 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:03:03.229903 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-565804fa-7878-4b1d-a6fd-fc80f71d9c87 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:03:03.230504 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-565804fa-7878-4b1d-a6fd-fc80f71d9c87 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: c4ee21e5-f99f-4c3f-a988-8304f8910950] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:03.236744 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-565804fa-7878-4b1d-a6fd-fc80f71d9c87 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:03.237218 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-565804fa-7878-4b1d-a6fd-fc80f71d9c87 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:03.237996 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-565804fa-7878-4b1d-a6fd-fc80f71d9c87 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:03.238436 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-565804fa-7878-4b1d-a6fd-fc80f71d9c87 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:03.363571 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-565804fa-7878-4b1d-a6fd-fc80f71d9c87 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c15b0f0444539936252906707a4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bee9dbebd64795afb8d03d5204db6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:03.371491 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-565804fa-7878-4b1d-a6fd-fc80f71d9c87 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "GET /compute/v2.1/servers/c4ee21e5-f99f-4c3f-a988-8304f8910950" status: 200 len: 1502 microversion: 2.1 time: 0.145353 Nov 23 09:03:03.372057 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 335/672] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:03:03 2021] GET /compute/v2.1/servers/c4ee21e5-f99f-4c3f-a988-8304f8910950 => generated 1502 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:03:04.389936 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-34dc32c9-62fa-4057-9ccc-b17e6f365d7d tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:03:04.390554 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-34dc32c9-62fa-4057-9ccc-b17e6f365d7d tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: c4ee21e5-f99f-4c3f-a988-8304f8910950] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:04.396827 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-34dc32c9-62fa-4057-9ccc-b17e6f365d7d tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:04.397312 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-34dc32c9-62fa-4057-9ccc-b17e6f365d7d tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:04.398090 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-34dc32c9-62fa-4057-9ccc-b17e6f365d7d tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:04.398563 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-34dc32c9-62fa-4057-9ccc-b17e6f365d7d tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:04.527476 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-34dc32c9-62fa-4057-9ccc-b17e6f365d7d tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c15b0f0444539936252906707a4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bee9dbebd64795afb8d03d5204db6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:04.534797 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-34dc32c9-62fa-4057-9ccc-b17e6f365d7d tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "GET /compute/v2.1/servers/c4ee21e5-f99f-4c3f-a988-8304f8910950" status: 200 len: 1502 microversion: 2.1 time: 0.148475 Nov 23 09:03:04.535373 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 338/673] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:03:04 2021] GET /compute/v2.1/servers/c4ee21e5-f99f-4c3f-a988-8304f8910950 => generated 1502 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:03:05.551716 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-ea3caa31-aefc-443a-b1dc-adfe7bf17c7d tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:03:05.552346 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-ea3caa31-aefc-443a-b1dc-adfe7bf17c7d tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: c4ee21e5-f99f-4c3f-a988-8304f8910950] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:05.559130 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ea3caa31-aefc-443a-b1dc-adfe7bf17c7d tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:05.559576 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ea3caa31-aefc-443a-b1dc-adfe7bf17c7d tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:05.560344 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ea3caa31-aefc-443a-b1dc-adfe7bf17c7d tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:05.560774 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ea3caa31-aefc-443a-b1dc-adfe7bf17c7d tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:05.872192 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-ea3caa31-aefc-443a-b1dc-adfe7bf17c7d tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c15b0f0444539936252906707a4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bee9dbebd64795afb8d03d5204db6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:05.872651 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-c60adf83-fe1c-4969-95c2-a7af36b7c61b req-731b521d-8ba2-411b-bd12-958b6a3dafd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4ee21e5-f99f-4c3f-a988-8304f8910950", "name": "network-vif-deleted", "tag": "649f9bb6-ab8a-4281-a990-56b616f8985e"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:03:05.874459 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:03:05.874459 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 09:03:05.879644 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-ea3caa31-aefc-443a-b1dc-adfe7bf17c7d tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "GET /compute/v2.1/servers/c4ee21e5-f99f-4c3f-a988-8304f8910950" status: 200 len: 1460 microversion: 2.1 time: 0.331576 Nov 23 09:03:05.880232 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 336/674] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:03:05 2021] GET /compute/v2.1/servers/c4ee21e5-f99f-4c3f-a988-8304f8910950 => generated 1460 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:03:05.883640 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-c60adf83-fe1c-4969-95c2-a7af36b7c61b req-731b521d-8ba2-411b-bd12-958b6a3dafd8 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:05.884086 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-c60adf83-fe1c-4969-95c2-a7af36b7c61b req-731b521d-8ba2-411b-bd12-958b6a3dafd8 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:05.895669 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-c60adf83-fe1c-4969-95c2-a7af36b7c61b req-731b521d-8ba2-411b-bd12-958b6a3dafd8 service nova] Creating event network-vif-deleted:649f9bb6-ab8a-4281-a990-56b616f8985e for instance c4ee21e5-f99f-4c3f-a988-8304f8910950 on hv-cinder-76845 Nov 23 09:03:05.901460 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-c60adf83-fe1c-4969-95c2-a7af36b7c61b req-731b521d-8ba2-411b-bd12-958b6a3dafd8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032044 Nov 23 09:03:05.902141 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 339/675] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:03:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 09:03:06.896997 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-699befcb-9244-459d-a4d5-15f3ed2f33c4 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:03:06.897618 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-699befcb-9244-459d-a4d5-15f3ed2f33c4 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] [instance: c4ee21e5-f99f-4c3f-a988-8304f8910950] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:06.904126 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-699befcb-9244-459d-a4d5-15f3ed2f33c4 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:06.904516 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-699befcb-9244-459d-a4d5-15f3ed2f33c4 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:06.905338 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-699befcb-9244-459d-a4d5-15f3ed2f33c4 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:06.905778 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-699befcb-9244-459d-a4d5-15f3ed2f33c4 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:06.920572 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.wsgi [None req-699befcb-9244-459d-a4d5-15f3ed2f33c4 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] HTTP exception thrown: Instance c4ee21e5-f99f-4c3f-a988-8304f8910950 could not be found. Nov 23 09:03:06.921148 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-699befcb-9244-459d-a4d5-15f3ed2f33c4 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] Returning 404 to user: Instance c4ee21e5-f99f-4c3f-a988-8304f8910950 could not be found. {{(pid=116227) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 09:03:06.921965 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-699befcb-9244-459d-a4d5-15f3ed2f33c4 tempest-VolumesActionsTest-442322915 tempest-VolumesActionsTest-442322915-project] 10.222.0.46 "GET /compute/v2.1/servers/c4ee21e5-f99f-4c3f-a988-8304f8910950" status: 404 len: 111 microversion: 2.1 time: 0.028659 Nov 23 09:03:06.922482 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 337/676] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:03:06 2021] GET /compute/v2.1/servers/c4ee21e5-f99f-4c3f-a988-8304f8910950 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 09:03:12.630729 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-34878489-9967-4018-92ff-219c69e741ae tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:03:12.631300 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-34878489-9967-4018-92ff-219c69e741ae tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:12.638266 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-34878489-9967-4018-92ff-219c69e741ae tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:12.638740 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-34878489-9967-4018-92ff-219c69e741ae tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:12.639533 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-34878489-9967-4018-92ff-219c69e741ae tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:12.639996 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-34878489-9967-4018-92ff-219c69e741ae tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:12.668063 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-34878489-9967-4018-92ff-219c69e741ae tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/os-volume_attachments/370ca257-a63c-450c-8a3f-7b7e7b601d49" status: 200 len: 194 microversion: 2.20 time: 0.042053 Nov 23 09:03:12.668644 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 340/677] 10.222.0.46 () {60 vars in 1453 bytes} [Tue Nov 23 09:03:12 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/os-volume_attachments/370ca257-a63c-450c-8a3f-7b7e7b601d49 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:03:12.891335 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-4d3cdfdc-9de6-4699-bb0b-90d782b5ea71 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:03:12.891869 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-4d3cdfdc-9de6-4699-bb0b-90d782b5ea71 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:12.898515 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4d3cdfdc-9de6-4699-bb0b-90d782b5ea71 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:12.898968 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4d3cdfdc-9de6-4699-bb0b-90d782b5ea71 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:12.899742 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4d3cdfdc-9de6-4699-bb0b-90d782b5ea71 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:12.900174 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4d3cdfdc-9de6-4699-bb0b-90d782b5ea71 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:12.975530 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.objects.instance [None req-4d3cdfdc-9de6-4699-bb0b-90d782b5ea71 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lazy-loading 'services' on Instance uuid 82569d71-833c-454b-a668-12dc9a37e7e2 {{(pid=116227) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 09:03:13.043577 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-4d3cdfdc-9de6-4699-bb0b-90d782b5ea71 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "DELETE /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/os-volume_attachments/370ca257-a63c-450c-8a3f-7b7e7b601d49" status: 202 len: 0 microversion: 2.20 time: 0.155719 Nov 23 09:03:13.044162 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 338/678] 10.222.0.46 () {60 vars in 1456 bytes} [Tue Nov 23 09:03:12 2021] DELETE /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/os-volume_attachments/370ca257-a63c-450c-8a3f-7b7e7b601d49 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 23 09:03:13.052593 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c9871067-937d-4080-a84e-3e28cb3edb68 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:03:13.053588 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c9871067-937d-4080-a84e-3e28cb3edb68 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:13.059726 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c9871067-937d-4080-a84e-3e28cb3edb68 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:13.060225 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c9871067-937d-4080-a84e-3e28cb3edb68 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:13.061006 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c9871067-937d-4080-a84e-3e28cb3edb68 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:13.061465 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c9871067-937d-4080-a84e-3e28cb3edb68 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:13.094896 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c9871067-937d-4080-a84e-3e28cb3edb68 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046248 Nov 23 09:03:13.095771 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 341/679] 10.222.0.46 () {60 vars in 1342 bytes} [Tue Nov 23 09:03:13 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:03:14.111263 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-d8f260fe-c52c-4ffd-ba75-1d53c7a1e526 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:03:14.112866 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-d8f260fe-c52c-4ffd-ba75-1d53c7a1e526 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:14.121303 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d8f260fe-c52c-4ffd-ba75-1d53c7a1e526 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:14.121770 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d8f260fe-c52c-4ffd-ba75-1d53c7a1e526 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:14.122576 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d8f260fe-c52c-4ffd-ba75-1d53c7a1e526 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:14.123020 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d8f260fe-c52c-4ffd-ba75-1d53c7a1e526 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:14.156888 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-d8f260fe-c52c-4ffd-ba75-1d53c7a1e526 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050993 Nov 23 09:03:14.157509 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 339/680] 10.222.0.46 () {60 vars in 1342 bytes} [Tue Nov 23 09:03:14 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:03:14.227870 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-24a26957-9475-49bd-bd01-bbb8edea60d0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:03:14.228503 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-24a26957-9475-49bd-bd01-bbb8edea60d0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:14.235103 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-24a26957-9475-49bd-bd01-bbb8edea60d0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:14.235503 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-24a26957-9475-49bd-bd01-bbb8edea60d0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:14.236307 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-24a26957-9475-49bd-bd01-bbb8edea60d0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:14.236739 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-24a26957-9475-49bd-bd01-bbb8edea60d0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:14.266544 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-24a26957-9475-49bd-bd01-bbb8edea60d0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Going to try to terminate instance {{(pid=116226) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 09:03:14.354065 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-24a26957-9475-49bd-bd01-bbb8edea60d0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "DELETE /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 204 len: 0 microversion: 2.20 time: 0.129888 Nov 23 09:03:14.355245 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 342/681] 10.222.0.46 () {60 vars in 1279 bytes} [Tue Nov 23 09:03:14 2021] DELETE /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 23 09:03:14.369602 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-a62dadb1-5e15-44d6-8954-e3254528dec1 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:03:14.370338 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-a62dadb1-5e15-44d6-8954-e3254528dec1 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:14.380841 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a62dadb1-5e15-44d6-8954-e3254528dec1 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:14.381782 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a62dadb1-5e15-44d6-8954-e3254528dec1 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:14.383951 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a62dadb1-5e15-44d6-8954-e3254528dec1 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:14.384822 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a62dadb1-5e15-44d6-8954-e3254528dec1 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:14.579494 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-a62dadb1-5e15-44d6-8954-e3254528dec1 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:14.594159 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-a62dadb1-5e15-44d6-8954-e3254528dec1 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:14.596854 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-a62dadb1-5e15-44d6-8954-e3254528dec1 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:14.599879 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-a62dadb1-5e15-44d6-8954-e3254528dec1 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1724 microversion: 2.20 time: 0.238377 Nov 23 09:03:14.603240 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 340/682] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:03:14 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:03:15.624637 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-029ae95e-6f58-42f5-97f6-ae55668e9f74 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:03:15.625820 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-029ae95e-6f58-42f5-97f6-ae55668e9f74 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:15.650546 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-029ae95e-6f58-42f5-97f6-ae55668e9f74 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:15.652081 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-029ae95e-6f58-42f5-97f6-ae55668e9f74 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:15.654657 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-029ae95e-6f58-42f5-97f6-ae55668e9f74 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:15.655581 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-029ae95e-6f58-42f5-97f6-ae55668e9f74 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:15.878847 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-029ae95e-6f58-42f5-97f6-ae55668e9f74 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:15.890811 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-029ae95e-6f58-42f5-97f6-ae55668e9f74 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:15.892147 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-029ae95e-6f58-42f5-97f6-ae55668e9f74 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:15.895471 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-029ae95e-6f58-42f5-97f6-ae55668e9f74 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1724 microversion: 2.20 time: 0.276721 Nov 23 09:03:15.901280 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 343/683] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:03:15 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1724 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:03:16.915543 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-7b435c63-890a-4cd4-b10a-87e13c6bbff0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:03:16.916204 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-7b435c63-890a-4cd4-b10a-87e13c6bbff0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:16.922482 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7b435c63-890a-4cd4-b10a-87e13c6bbff0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:16.923041 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7b435c63-890a-4cd4-b10a-87e13c6bbff0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:16.923835 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7b435c63-890a-4cd4-b10a-87e13c6bbff0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:16.924410 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7b435c63-890a-4cd4-b10a-87e13c6bbff0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:17.078342 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-7b435c63-890a-4cd4-b10a-87e13c6bbff0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:17.087996 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-7b435c63-890a-4cd4-b10a-87e13c6bbff0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:17.091265 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-7b435c63-890a-4cd4-b10a-87e13c6bbff0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:17.092904 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-7b435c63-890a-4cd4-b10a-87e13c6bbff0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1724 microversion: 2.20 time: 0.181505 Nov 23 09:03:17.104871 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 341/684] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:03:16 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:03:18.114665 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-4d620030-4859-4b89-acae-d67648fc955a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:03:18.115542 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-4d620030-4859-4b89-acae-d67648fc955a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:18.125033 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4d620030-4859-4b89-acae-d67648fc955a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:18.125617 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4d620030-4859-4b89-acae-d67648fc955a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:18.126668 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4d620030-4859-4b89-acae-d67648fc955a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:18.127232 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4d620030-4859-4b89-acae-d67648fc955a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:18.299569 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-4d620030-4859-4b89-acae-d67648fc955a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:18.309806 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-4d620030-4859-4b89-acae-d67648fc955a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:18.311555 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-4d620030-4859-4b89-acae-d67648fc955a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:18.312773 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-4d620030-4859-4b89-acae-d67648fc955a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1724 microversion: 2.20 time: 0.203824 Nov 23 09:03:18.313393 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 344/685] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:03:18 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:03:19.334487 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-1738583c-c120-4afa-8eda-71711175f7e5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:03:19.335824 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-1738583c-c120-4afa-8eda-71711175f7e5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:19.343471 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1738583c-c120-4afa-8eda-71711175f7e5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:19.344058 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1738583c-c120-4afa-8eda-71711175f7e5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:19.345003 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1738583c-c120-4afa-8eda-71711175f7e5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:19.345709 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1738583c-c120-4afa-8eda-71711175f7e5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:19.629786 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-1738583c-c120-4afa-8eda-71711175f7e5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:19.643644 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-1738583c-c120-4afa-8eda-71711175f7e5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:19.649084 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-1738583c-c120-4afa-8eda-71711175f7e5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:19.652128 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-1738583c-c120-4afa-8eda-71711175f7e5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1724 microversion: 2.20 time: 0.320655 Nov 23 09:03:19.652128 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 342/686] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:03:19 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1724 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:03:20.271945 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-242e1600-4f75-4db5-8e09-99f1a1e6e8fb req-885f57e6-2629-4153-8c88-c9cf89b0bd8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82569d71-833c-454b-a668-12dc9a37e7e2", "name": "network-vif-deleted", "tag": "efe7e8ac-f495-4361-902c-7da559e50715"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:03:20.274446 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:03:20.274446 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 09:03:20.295405 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-242e1600-4f75-4db5-8e09-99f1a1e6e8fb req-885f57e6-2629-4153-8c88-c9cf89b0bd8a service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:20.295855 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-242e1600-4f75-4db5-8e09-99f1a1e6e8fb req-885f57e6-2629-4153-8c88-c9cf89b0bd8a service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:20.311236 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-242e1600-4f75-4db5-8e09-99f1a1e6e8fb req-885f57e6-2629-4153-8c88-c9cf89b0bd8a service nova] Creating event network-vif-deleted:efe7e8ac-f495-4361-902c-7da559e50715 for instance 82569d71-833c-454b-a668-12dc9a37e7e2 on hv-cinder-76845 Nov 23 09:03:20.326431 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-242e1600-4f75-4db5-8e09-99f1a1e6e8fb req-885f57e6-2629-4153-8c88-c9cf89b0bd8a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058224 Nov 23 09:03:20.327680 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 345/687] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:03:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:03:20.670356 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-69843985-767d-477e-ad81-ac040713bb08 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:03:20.671666 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-69843985-767d-477e-ad81-ac040713bb08 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:20.683558 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-69843985-767d-477e-ad81-ac040713bb08 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:20.684360 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-69843985-767d-477e-ad81-ac040713bb08 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:20.685911 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-69843985-767d-477e-ad81-ac040713bb08 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:20.686549 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-69843985-767d-477e-ad81-ac040713bb08 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:20.728774 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-69843985-767d-477e-ad81-ac040713bb08 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:20.729922 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-69843985-767d-477e-ad81-ac040713bb08 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:20.730724 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.objects.instance [None req-69843985-767d-477e-ad81-ac040713bb08 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lazy-loading 'fault' on Instance uuid 82569d71-833c-454b-a668-12dc9a37e7e2 {{(pid=116227) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 09:03:20.793675 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-69843985-767d-477e-ad81-ac040713bb08 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:20.811814 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-69843985-767d-477e-ad81-ac040713bb08 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:20.813863 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-69843985-767d-477e-ad81-ac040713bb08 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:20.817031 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-69843985-767d-477e-ad81-ac040713bb08 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 200 len: 1371 microversion: 2.20 time: 0.149140 Nov 23 09:03:20.820561 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 343/688] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:03:20 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:03:21.840925 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-2e0abd3a-b143-4b2f-a250-e3632a8f28ad tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:03:21.842302 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-2e0abd3a-b143-4b2f-a250-e3632a8f28ad tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:21.848999 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2e0abd3a-b143-4b2f-a250-e3632a8f28ad tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:21.849750 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2e0abd3a-b143-4b2f-a250-e3632a8f28ad tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:21.851347 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2e0abd3a-b143-4b2f-a250-e3632a8f28ad tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:21.852350 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2e0abd3a-b143-4b2f-a250-e3632a8f28ad tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:21.869209 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-2e0abd3a-b143-4b2f-a250-e3632a8f28ad tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] HTTP exception thrown: Instance 82569d71-833c-454b-a668-12dc9a37e7e2 could not be found. Nov 23 09:03:21.870084 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-2e0abd3a-b143-4b2f-a250-e3632a8f28ad tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Returning 404 to user: Instance 82569d71-833c-454b-a668-12dc9a37e7e2 could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 09:03:21.871095 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-2e0abd3a-b143-4b2f-a250-e3632a8f28ad tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 404 len: 111 microversion: 2.20 time: 0.037033 Nov 23 09:03:21.872165 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 346/689] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:03:21 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 23 09:03:21.882429 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-caf30f2b-0800-4bf4-b0a3-abd03c6e970d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '.version_select at 0x7f527aaffa60>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:03:21.958781 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-caf30f2b-0800-4bf4-b0a3-abd03c6e970d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1485152784" status: 204 len: 0 microversion: 2.20 time: 0.082152 Nov 23 09:03:21.963299 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 344/690] 10.222.0.46 () {60 vars in 1261 bytes} [Tue Nov 23 09:03:21 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1485152784 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 23 09:03:22.807227 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-df256a4b-09e0-49d8-ad8a-e9bc2affdbac tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'create', calling method: .version_select at 0x7f527a4d7f70>, body: {"keypair": {"name": "tempest-keypair-1713030377"}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:03:22.824670 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-df256a4b-09e0-49d8-ad8a-e9bc2affdbac tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Getting quotas for project e25886501fbd4758b06603593508fd2c. Resources: {'key_pairs'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 09:03:22.829151 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-df256a4b-09e0-49d8-ad8a-e9bc2affdbac tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Getting quotas for user deddc2bd931e42168ab8f2256a77fe70 and project e25886501fbd4758b06603593508fd2c. Resources: {'key_pairs'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 09:03:22.939274 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-df256a4b-09e0-49d8-ad8a-e9bc2affdbac tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Getting quotas for project e25886501fbd4758b06603593508fd2c. Resources: {'key_pairs'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 09:03:22.943151 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-df256a4b-09e0-49d8-ad8a-e9bc2affdbac tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Getting quotas for user deddc2bd931e42168ab8f2256a77fe70 and project e25886501fbd4758b06603593508fd2c. Resources: {'key_pairs'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 09:03:22.958742 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-df256a4b-09e0-49d8-ad8a-e9bc2affdbac tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.156261 Nov 23 09:03:22.959436 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 347/691] 10.222.0.46 () {62 vars in 1198 bytes} [Tue Nov 23 09:03:22 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 158 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 23 09:03:24.664160 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-d0277856-cb1e-486d-abdb-dce3bf329239 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-752991410", "imageRef": "18424a16-ac32-42d5-8161-d6cb36423de3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "173e57ff-5d80-4e2b-b8fe-bc64d9610472"}], "security_groups": [{"name": "tempest-securitygroup--570687126"}], "key_name": "tempest-keypair-1713030377", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:03:24.810602 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.network.neutron [None req-d0277856-cb1e-486d-abdb-dce3bf329239 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] validate_networks() for [('173e57ff-5d80-4e2b-b8fe-bc64d9610472', None, None, None, None, None)] {{(pid=116227) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 09:03:25.266642 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.virt.hardware [None req-d0277856-cb1e-486d-abdb-dce3bf329239 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Flavor limits 0:0:0 {{(pid=116227) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 09:03:25.267084 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.virt.hardware [None req-d0277856-cb1e-486d-abdb-dce3bf329239 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Image limits 0:0:0 {{(pid=116227) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 09:03:25.267564 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.virt.hardware [None req-d0277856-cb1e-486d-abdb-dce3bf329239 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Flavor pref 0:0:0 {{(pid=116227) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 09:03:25.267979 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.virt.hardware [None req-d0277856-cb1e-486d-abdb-dce3bf329239 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Image pref 0:0:0 {{(pid=116227) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 09:03:25.268394 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.virt.hardware [None req-d0277856-cb1e-486d-abdb-dce3bf329239 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116227) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 09:03:25.282045 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d0277856-cb1e-486d-abdb-dce3bf329239 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:25.283022 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d0277856-cb1e-486d-abdb-dce3bf329239 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:25.284404 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d0277856-cb1e-486d-abdb-dce3bf329239 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:25.285137 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d0277856-cb1e-486d-abdb-dce3bf329239 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:25.312505 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.quota [None req-d0277856-cb1e-486d-abdb-dce3bf329239 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Getting quotas for project e25886501fbd4758b06603593508fd2c. Resources: {'instances', 'ram', 'cores'} {{(pid=116227) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 09:03:25.318455 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.quota [None req-d0277856-cb1e-486d-abdb-dce3bf329239 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Getting quotas for user deddc2bd931e42168ab8f2256a77fe70 and project e25886501fbd4758b06603593508fd2c. Resources: {'instances', 'ram', 'cores'} {{(pid=116227) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 09:03:25.339767 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-d0277856-cb1e-486d-abdb-dce3bf329239 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Going to run 1 instances... {{(pid=116227) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 09:03:25.342144 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-d0277856-cb1e-486d-abdb-dce3bf329239 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='18424a16-ac32-42d5-8161-d6cb36423de3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116227) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 09:03:25.404330 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-d0277856-cb1e-486d-abdb-dce3bf329239 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.747844 Nov 23 09:03:25.409318 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 345/692] 10.222.0.46 () {62 vars in 1187 bytes} [Tue Nov 23 09:03:24 2021] POST /compute/v2.1/servers => generated 401 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 23 09:03:25.417440 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-39c16257-47de-4d1d-9735-f2d1f833cf1d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:03:25.419037 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-39c16257-47de-4d1d-9735-f2d1f833cf1d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:25.504177 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-39c16257-47de-4d1d-9735-f2d1f833cf1d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:25.511442 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-39c16257-47de-4d1d-9735-f2d1f833cf1d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:25.512959 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-39c16257-47de-4d1d-9735-f2d1f833cf1d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:25.514011 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-39c16257-47de-4d1d-9735-f2d1f833cf1d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1281 microversion: 2.20 time: 0.102162 Nov 23 09:03:25.514576 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 348/693] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:03:25 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1281 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:03:26.534481 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-40f885ca-e243-464d-8072-eff153376c94 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:03:26.536246 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-40f885ca-e243-464d-8072-eff153376c94 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:26.545363 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-40f885ca-e243-464d-8072-eff153376c94 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:26.546056 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-40f885ca-e243-464d-8072-eff153376c94 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:26.547127 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-40f885ca-e243-464d-8072-eff153376c94 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:26.547638 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-40f885ca-e243-464d-8072-eff153376c94 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:26.638639 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-40f885ca-e243-464d-8072-eff153376c94 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:26.648322 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-40f885ca-e243-464d-8072-eff153376c94 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:26.650424 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-40f885ca-e243-464d-8072-eff153376c94 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:26.652117 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-40f885ca-e243-464d-8072-eff153376c94 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1333 microversion: 2.20 time: 0.123933 Nov 23 09:03:26.653342 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 346/694] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:03:26 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1333 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:03:27.670871 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-1144d43a-94bd-4817-9da6-44daa76bc652 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:03:27.671572 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-1144d43a-94bd-4817-9da6-44daa76bc652 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:27.679131 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1144d43a-94bd-4817-9da6-44daa76bc652 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:27.679526 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1144d43a-94bd-4817-9da6-44daa76bc652 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:27.681424 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1144d43a-94bd-4817-9da6-44daa76bc652 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:27.686058 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1144d43a-94bd-4817-9da6-44daa76bc652 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:27.912185 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-1144d43a-94bd-4817-9da6-44daa76bc652 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:27.921038 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-1144d43a-94bd-4817-9da6-44daa76bc652 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:27.923039 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-1144d43a-94bd-4817-9da6-44daa76bc652 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:27.924337 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-1144d43a-94bd-4817-9da6-44daa76bc652 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1406 microversion: 2.20 time: 0.257160 Nov 23 09:03:27.925392 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 349/695] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:03:27 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1406 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:03:28.492269 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-98a6ec04-665d-4f2a-a1e3-f9fba0cd2ac2 req-92ab5afc-95f9-45e0-8d98-3ded8504efbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33d3a8a8-651e-4b5e-ac3a-2032c9d60800", "tag": "9c88cc6d-9402-4eb1-bcaf-c79ca859d7c3"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:03:28.497373 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:03:28.497373 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 09:03:28.512580 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-98a6ec04-665d-4f2a-a1e3-f9fba0cd2ac2 req-92ab5afc-95f9-45e0-8d98-3ded8504efbb service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:28.515474 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-98a6ec04-665d-4f2a-a1e3-f9fba0cd2ac2 req-92ab5afc-95f9-45e0-8d98-3ded8504efbb service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:28.545435 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-98a6ec04-665d-4f2a-a1e3-f9fba0cd2ac2 req-92ab5afc-95f9-45e0-8d98-3ded8504efbb service nova] Creating event network-changed:9c88cc6d-9402-4eb1-bcaf-c79ca859d7c3 for instance 33d3a8a8-651e-4b5e-ac3a-2032c9d60800 on hv-cinder-76845 Nov 23 09:03:28.552673 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-98a6ec04-665d-4f2a-a1e3-f9fba0cd2ac2 req-92ab5afc-95f9-45e0-8d98-3ded8504efbb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069574 Nov 23 09:03:28.553561 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 347/696] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:03:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:03:28.943122 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-ddedcab6-d181-45b5-9306-064dabcd4c30 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:03:28.943726 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-ddedcab6-d181-45b5-9306-064dabcd4c30 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:28.950839 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ddedcab6-d181-45b5-9306-064dabcd4c30 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:28.951603 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ddedcab6-d181-45b5-9306-064dabcd4c30 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:28.952423 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ddedcab6-d181-45b5-9306-064dabcd4c30 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:28.952852 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ddedcab6-d181-45b5-9306-064dabcd4c30 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:29.157551 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-ddedcab6-d181-45b5-9306-064dabcd4c30 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:29.167482 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-ddedcab6-d181-45b5-9306-064dabcd4c30 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:29.169057 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-ddedcab6-d181-45b5-9306-064dabcd4c30 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:29.170372 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-ddedcab6-d181-45b5-9306-064dabcd4c30 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1406 microversion: 2.20 time: 0.230918 Nov 23 09:03:29.170794 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 350/697] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:03:28 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:03:30.189056 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-3b7f5490-6771-4d46-9464-48764114e87b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:03:30.189767 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-3b7f5490-6771-4d46-9464-48764114e87b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:30.198397 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3b7f5490-6771-4d46-9464-48764114e87b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:30.199045 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3b7f5490-6771-4d46-9464-48764114e87b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:30.200101 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3b7f5490-6771-4d46-9464-48764114e87b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:30.200741 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3b7f5490-6771-4d46-9464-48764114e87b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:30.375700 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-3b7f5490-6771-4d46-9464-48764114e87b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:30.384041 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-3b7f5490-6771-4d46-9464-48764114e87b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:30.385643 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-3b7f5490-6771-4d46-9464-48764114e87b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:30.386758 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-3b7f5490-6771-4d46-9464-48764114e87b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1406 microversion: 2.20 time: 0.201678 Nov 23 09:03:30.390053 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 348/698] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:03:30 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1406 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:03:31.404392 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-33b9d01b-4b7e-4606-a5a6-883bb3541487 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:03:31.404991 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-33b9d01b-4b7e-4606-a5a6-883bb3541487 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:31.411226 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-33b9d01b-4b7e-4606-a5a6-883bb3541487 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:31.411674 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-33b9d01b-4b7e-4606-a5a6-883bb3541487 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:31.412444 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-33b9d01b-4b7e-4606-a5a6-883bb3541487 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:31.412958 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-33b9d01b-4b7e-4606-a5a6-883bb3541487 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:31.546715 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-33b9d01b-4b7e-4606-a5a6-883bb3541487 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:31.555422 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-33b9d01b-4b7e-4606-a5a6-883bb3541487 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:31.557344 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-33b9d01b-4b7e-4606-a5a6-883bb3541487 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:31.558550 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-33b9d01b-4b7e-4606-a5a6-883bb3541487 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1406 microversion: 2.20 time: 0.157841 Nov 23 09:03:31.559204 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 351/699] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:03:31 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:03:32.577963 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-98ead3fb-cf4e-4c95-8859-fafceb2507b8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:03:32.578591 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-98ead3fb-cf4e-4c95-8859-fafceb2507b8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:32.587673 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-98ead3fb-cf4e-4c95-8859-fafceb2507b8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:32.588142 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-98ead3fb-cf4e-4c95-8859-fafceb2507b8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:32.589474 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-98ead3fb-cf4e-4c95-8859-fafceb2507b8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:32.589924 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-98ead3fb-cf4e-4c95-8859-fafceb2507b8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:32.727103 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-98ead3fb-cf4e-4c95-8859-fafceb2507b8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:32.735159 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-98ead3fb-cf4e-4c95-8859-fafceb2507b8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:32.736678 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-98ead3fb-cf4e-4c95-8859-fafceb2507b8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:32.737815 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-98ead3fb-cf4e-4c95-8859-fafceb2507b8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1406 microversion: 2.20 time: 0.163668 Nov 23 09:03:32.738381 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 349/700] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:03:32 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:03:33.755270 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-2cc1dc9b-c061-4c3d-8011-f10574b536a5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:03:33.756003 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-2cc1dc9b-c061-4c3d-8011-f10574b536a5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:33.762656 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2cc1dc9b-c061-4c3d-8011-f10574b536a5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:33.763108 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2cc1dc9b-c061-4c3d-8011-f10574b536a5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:33.763879 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2cc1dc9b-c061-4c3d-8011-f10574b536a5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:33.764312 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2cc1dc9b-c061-4c3d-8011-f10574b536a5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:33.938828 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-2cc1dc9b-c061-4c3d-8011-f10574b536a5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:33.948814 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-2cc1dc9b-c061-4c3d-8011-f10574b536a5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:33.950521 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-2cc1dc9b-c061-4c3d-8011-f10574b536a5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:33.951630 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-2cc1dc9b-c061-4c3d-8011-f10574b536a5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1406 microversion: 2.20 time: 0.199961 Nov 23 09:03:33.952481 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 352/701] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:03:33 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:03:34.810697 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-1b8bd12f-1764-4037-b447-89cfe2d216f9 req-348557f7-0540-42ba-afa8-967ac389bdbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33d3a8a8-651e-4b5e-ac3a-2032c9d60800", "name": "network-vif-plugged", "status": "completed", "tag": "9c88cc6d-9402-4eb1-bcaf-c79ca859d7c3"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:03:34.812509 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:03:34.812509 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 09:03:34.822130 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-1b8bd12f-1764-4037-b447-89cfe2d216f9 req-348557f7-0540-42ba-afa8-967ac389bdbe service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:34.823859 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-1b8bd12f-1764-4037-b447-89cfe2d216f9 req-348557f7-0540-42ba-afa8-967ac389bdbe service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:34.836740 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-1b8bd12f-1764-4037-b447-89cfe2d216f9 req-348557f7-0540-42ba-afa8-967ac389bdbe service nova] Creating event network-vif-plugged:9c88cc6d-9402-4eb1-bcaf-c79ca859d7c3 for instance 33d3a8a8-651e-4b5e-ac3a-2032c9d60800 on hv-cinder-76845 Nov 23 09:03:34.843047 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-1b8bd12f-1764-4037-b447-89cfe2d216f9 req-348557f7-0540-42ba-afa8-967ac389bdbe service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036817 Nov 23 09:03:34.843656 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 350/702] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:03:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:03:34.971513 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c2660c1d-5f6e-462f-baf0-f758f2d68d42 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:03:34.972131 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c2660c1d-5f6e-462f-baf0-f758f2d68d42 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:34.979236 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c2660c1d-5f6e-462f-baf0-f758f2d68d42 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:34.979690 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c2660c1d-5f6e-462f-baf0-f758f2d68d42 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:34.980490 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c2660c1d-5f6e-462f-baf0-f758f2d68d42 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:34.980918 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c2660c1d-5f6e-462f-baf0-f758f2d68d42 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:35.132961 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-c2660c1d-5f6e-462f-baf0-f758f2d68d42 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:35.140814 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-c2660c1d-5f6e-462f-baf0-f758f2d68d42 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:35.142357 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-c2660c1d-5f6e-462f-baf0-f758f2d68d42 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:35.143469 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c2660c1d-5f6e-462f-baf0-f758f2d68d42 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1406 microversion: 2.20 time: 0.175719 Nov 23 09:03:35.144039 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 353/703] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:03:34 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:03:36.164145 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-8d64d96b-97a1-4b65-84ac-4c55361af6d8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:03:36.165027 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-8d64d96b-97a1-4b65-84ac-4c55361af6d8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:36.172054 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8d64d96b-97a1-4b65-84ac-4c55361af6d8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:36.172626 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8d64d96b-97a1-4b65-84ac-4c55361af6d8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:36.181417 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8d64d96b-97a1-4b65-84ac-4c55361af6d8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:36.181417 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8d64d96b-97a1-4b65-84ac-4c55361af6d8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:36.524429 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-8d64d96b-97a1-4b65-84ac-4c55361af6d8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:36.532369 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-8d64d96b-97a1-4b65-84ac-4c55361af6d8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:36.533903 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-8d64d96b-97a1-4b65-84ac-4c55361af6d8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:36.535001 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-8d64d96b-97a1-4b65-84ac-4c55361af6d8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1406 microversion: 2.20 time: 0.376388 Nov 23 09:03:36.535563 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 351/704] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:03:36 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1406 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:03:37.554391 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-6225728c-e169-40c7-a133-7965e99f190d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:03:37.555165 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-6225728c-e169-40c7-a133-7965e99f190d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:37.562314 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6225728c-e169-40c7-a133-7965e99f190d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:37.563368 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6225728c-e169-40c7-a133-7965e99f190d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:37.566452 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6225728c-e169-40c7-a133-7965e99f190d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:37.567063 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6225728c-e169-40c7-a133-7965e99f190d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:37.752481 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-6225728c-e169-40c7-a133-7965e99f190d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:37.760737 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-6225728c-e169-40c7-a133-7965e99f190d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:37.762263 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-6225728c-e169-40c7-a133-7965e99f190d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:03:37.763397 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-6225728c-e169-40c7-a133-7965e99f190d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1598 microversion: 2.20 time: 0.213081 Nov 23 09:03:37.763951 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 354/705] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:03:37 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1598 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:03:37.780318 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-9e72d401-3bf9-4a38-9338-88438afe0b05 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:03:37.780913 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-9e72d401-3bf9-4a38-9338-88438afe0b05 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:37.787559 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9e72d401-3bf9-4a38-9338-88438afe0b05 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:37.788097 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9e72d401-3bf9-4a38-9338-88438afe0b05 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:37.788929 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9e72d401-3bf9-4a38-9338-88438afe0b05 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:37.789420 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9e72d401-3bf9-4a38-9338-88438afe0b05 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:37.870727 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-9e72d401-3bf9-4a38-9338-88438afe0b05 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094017 Nov 23 09:03:37.871362 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 352/706] 10.222.0.46 () {60 vars in 1315 bytes} [Tue Nov 23 09:03:37 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:03:39.057805 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a3dc9fcd-c803-45a6-be3f-d0d3e00e2f20 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:03:39.059196 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-39b8903a-5506-4bc2-b2d8-5457b0a3e256 req-86f453c0-f25b-4030-b1c9-d433f0e615c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33d3a8a8-651e-4b5e-ac3a-2032c9d60800", "tag": "9c88cc6d-9402-4eb1-bcaf-c79ca859d7c3"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:03:39.059654 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a3dc9fcd-c803-45a6-be3f-d0d3e00e2f20 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:39.060670 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:03:39.060670 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 09:03:39.066545 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a3dc9fcd-c803-45a6-be3f-d0d3e00e2f20 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:39.067110 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a3dc9fcd-c803-45a6-be3f-d0d3e00e2f20 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:39.067950 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-39b8903a-5506-4bc2-b2d8-5457b0a3e256 req-86f453c0-f25b-4030-b1c9-d433f0e615c2 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:39.068150 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a3dc9fcd-c803-45a6-be3f-d0d3e00e2f20 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:39.068401 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-39b8903a-5506-4bc2-b2d8-5457b0a3e256 req-86f453c0-f25b-4030-b1c9-d433f0e615c2 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:39.070387 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a3dc9fcd-c803-45a6-be3f-d0d3e00e2f20 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:39.080971 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-39b8903a-5506-4bc2-b2d8-5457b0a3e256 req-86f453c0-f25b-4030-b1c9-d433f0e615c2 service nova] Creating event network-changed:9c88cc6d-9402-4eb1-bcaf-c79ca859d7c3 for instance 33d3a8a8-651e-4b5e-ac3a-2032c9d60800 on hv-cinder-76845 Nov 23 09:03:39.091633 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-39b8903a-5506-4bc2-b2d8-5457b0a3e256 req-86f453c0-f25b-4030-b1c9-d433f0e615c2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035745 Nov 23 09:03:39.097779 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 353/707] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:03:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:03:40.961342 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a3dc9fcd-c803-45a6-be3f-d0d3e00e2f20 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action" status: 200 len: 14 microversion: 2.20 time: 1.908495 Nov 23 09:03:40.962267 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 355/708] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:03:39 2021] POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action => generated 14 bytes in 1910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:03:41.972121 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-5a0463a8-5582-4d83-8d01-465d9261c703 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:03:41.973114 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-5a0463a8-5582-4d83-8d01-465d9261c703 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:41.980422 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5a0463a8-5582-4d83-8d01-465d9261c703 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:41.980870 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5a0463a8-5582-4d83-8d01-465d9261c703 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:41.981685 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5a0463a8-5582-4d83-8d01-465d9261c703 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:41.982125 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5a0463a8-5582-4d83-8d01-465d9261c703 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:42.042373 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-5a0463a8-5582-4d83-8d01-465d9261c703 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action" status: 200 len: 14 microversion: 2.20 time: 0.073977 Nov 23 09:03:42.043205 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 354/709] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:03:41 2021] POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:03:43.054096 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-693efbda-3750-4a78-8b3d-a697213d70c0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:03:43.055010 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-693efbda-3750-4a78-8b3d-a697213d70c0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:43.061784 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-693efbda-3750-4a78-8b3d-a697213d70c0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:43.062231 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-693efbda-3750-4a78-8b3d-a697213d70c0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:43.063002 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-693efbda-3750-4a78-8b3d-a697213d70c0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:43.063437 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-693efbda-3750-4a78-8b3d-a697213d70c0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:43.131798 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-693efbda-3750-4a78-8b3d-a697213d70c0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action" status: 200 len: 14 microversion: 2.20 time: 0.081192 Nov 23 09:03:43.132473 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 356/710] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:03:43 2021] POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:03:44.143347 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-abe928b9-703b-42ad-86e9-1e7e2c6f27cc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:03:44.144331 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-abe928b9-703b-42ad-86e9-1e7e2c6f27cc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:44.151930 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-abe928b9-703b-42ad-86e9-1e7e2c6f27cc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:44.152377 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-abe928b9-703b-42ad-86e9-1e7e2c6f27cc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:44.153146 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-abe928b9-703b-42ad-86e9-1e7e2c6f27cc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:44.153598 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-abe928b9-703b-42ad-86e9-1e7e2c6f27cc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:44.213174 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-abe928b9-703b-42ad-86e9-1e7e2c6f27cc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action" status: 200 len: 14 microversion: 2.20 time: 0.073653 Nov 23 09:03:44.216318 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 355/711] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:03:44 2021] POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:03:45.224363 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-7d680fab-2e45-4250-900b-861554048f5d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:03:45.225974 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-7d680fab-2e45-4250-900b-861554048f5d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:45.232706 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7d680fab-2e45-4250-900b-861554048f5d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:45.233153 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7d680fab-2e45-4250-900b-861554048f5d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:45.233951 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7d680fab-2e45-4250-900b-861554048f5d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:45.234378 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7d680fab-2e45-4250-900b-861554048f5d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:45.296901 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-7d680fab-2e45-4250-900b-861554048f5d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action" status: 200 len: 14 microversion: 2.20 time: 0.076385 Nov 23 09:03:45.297578 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 357/712] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:03:45 2021] POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:03:46.308713 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-29f28ff0-1a2d-405d-8fe6-6b6a82a12b6b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:03:46.309790 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-29f28ff0-1a2d-405d-8fe6-6b6a82a12b6b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:46.317305 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-29f28ff0-1a2d-405d-8fe6-6b6a82a12b6b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:46.317814 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-29f28ff0-1a2d-405d-8fe6-6b6a82a12b6b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:46.318722 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-29f28ff0-1a2d-405d-8fe6-6b6a82a12b6b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:46.319736 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-29f28ff0-1a2d-405d-8fe6-6b6a82a12b6b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:46.385268 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-29f28ff0-1a2d-405d-8fe6-6b6a82a12b6b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action" status: 200 len: 14 microversion: 2.20 time: 0.080797 Nov 23 09:03:46.385833 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 356/713] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:03:46 2021] POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:03:47.500825 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b3311b2e-b0e7-425d-9e70-83826631d89a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:03:47.502629 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b3311b2e-b0e7-425d-9e70-83826631d89a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:47.509501 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b3311b2e-b0e7-425d-9e70-83826631d89a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:47.509966 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b3311b2e-b0e7-425d-9e70-83826631d89a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:47.510760 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b3311b2e-b0e7-425d-9e70-83826631d89a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:47.511193 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b3311b2e-b0e7-425d-9e70-83826631d89a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:47.577821 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b3311b2e-b0e7-425d-9e70-83826631d89a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action" status: 200 len: 14 microversion: 2.20 time: 0.185315 Nov 23 09:03:47.578585 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 358/714] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:03:47 2021] POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action => generated 14 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:03:48.589651 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-dcaadd90-bc6f-4696-82df-f842c4081d8f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:03:48.590811 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-dcaadd90-bc6f-4696-82df-f842c4081d8f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:48.598082 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-dcaadd90-bc6f-4696-82df-f842c4081d8f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:48.598529 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-dcaadd90-bc6f-4696-82df-f842c4081d8f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:48.599305 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-dcaadd90-bc6f-4696-82df-f842c4081d8f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:48.599739 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-dcaadd90-bc6f-4696-82df-f842c4081d8f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:48.661356 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-dcaadd90-bc6f-4696-82df-f842c4081d8f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action" status: 200 len: 14 microversion: 2.20 time: 0.076512 Nov 23 09:03:48.662118 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 357/715] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:03:48 2021] POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:03:49.673541 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-0ab0272d-1234-4586-8d1b-d0a95c790573 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:03:49.674601 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-0ab0272d-1234-4586-8d1b-d0a95c790573 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:49.682939 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ab0272d-1234-4586-8d1b-d0a95c790573 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:49.683463 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ab0272d-1234-4586-8d1b-d0a95c790573 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:49.684261 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ab0272d-1234-4586-8d1b-d0a95c790573 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:49.684696 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ab0272d-1234-4586-8d1b-d0a95c790573 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:49.748353 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-0ab0272d-1234-4586-8d1b-d0a95c790573 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action" status: 200 len: 14 microversion: 2.20 time: 0.079118 Nov 23 09:03:49.748952 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 359/716] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:03:49 2021] POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:03:50.760046 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-c0f9e929-2abd-4b48-8f3f-f7979bb830db tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:03:50.761041 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-c0f9e929-2abd-4b48-8f3f-f7979bb830db tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:50.768321 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c0f9e929-2abd-4b48-8f3f-f7979bb830db tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:50.768768 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c0f9e929-2abd-4b48-8f3f-f7979bb830db tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:50.769593 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c0f9e929-2abd-4b48-8f3f-f7979bb830db tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:50.770028 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c0f9e929-2abd-4b48-8f3f-f7979bb830db tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:50.850538 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-c0f9e929-2abd-4b48-8f3f-f7979bb830db tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action" status: 200 len: 6451 microversion: 2.20 time: 0.094727 Nov 23 09:03:50.851883 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 358/717] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:03:50 2021] POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action => generated 6451 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:03:51.863372 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-22cff21d-d4ab-4f9f-aea6-fcce4fb7df8d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:03:51.864447 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-22cff21d-d4ab-4f9f-aea6-fcce4fb7df8d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:51.873592 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-22cff21d-d4ab-4f9f-aea6-fcce4fb7df8d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:51.874036 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-22cff21d-d4ab-4f9f-aea6-fcce4fb7df8d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:51.874820 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-22cff21d-d4ab-4f9f-aea6-fcce4fb7df8d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:51.875248 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-22cff21d-d4ab-4f9f-aea6-fcce4fb7df8d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:51.947775 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-22cff21d-d4ab-4f9f-aea6-fcce4fb7df8d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action" status: 200 len: 13243 microversion: 2.20 time: 0.088933 Nov 23 09:03:51.948412 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 360/718] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:03:51 2021] POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action => generated 13243 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:03:52.959516 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-f2e15deb-e620-4c88-846e-777823e31832 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:03:52.960492 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-f2e15deb-e620-4c88-846e-777823e31832 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:52.968426 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f2e15deb-e620-4c88-846e-777823e31832 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:52.968872 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f2e15deb-e620-4c88-846e-777823e31832 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:52.969673 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f2e15deb-e620-4c88-846e-777823e31832 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:52.970115 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f2e15deb-e620-4c88-846e-777823e31832 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:53.037819 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-f2e15deb-e620-4c88-846e-777823e31832 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action" status: 200 len: 18356 microversion: 2.20 time: 0.082141 Nov 23 09:03:53.038460 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 359/719] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:03:52 2021] POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action => generated 18356 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:03:54.049950 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-0ae7638d-4ad1-4963-bca3-f5e983dbe105 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:03:54.050936 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-0ae7638d-4ad1-4963-bca3-f5e983dbe105 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:54.058364 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ae7638d-4ad1-4963-bca3-f5e983dbe105 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:54.058808 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ae7638d-4ad1-4963-bca3-f5e983dbe105 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:54.059574 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ae7638d-4ad1-4963-bca3-f5e983dbe105 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:54.060007 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ae7638d-4ad1-4963-bca3-f5e983dbe105 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:54.137724 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-0ae7638d-4ad1-4963-bca3-f5e983dbe105 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action" status: 200 len: 19133 microversion: 2.20 time: 0.091658 Nov 23 09:03:54.138365 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 361/720] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:03:54 2021] POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action => generated 19133 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:03:55.150501 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-7a1389a6-718c-4de8-b3d1-e497c538bce7 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:03:55.151486 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-7a1389a6-718c-4de8-b3d1-e497c538bce7 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:55.166459 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7a1389a6-718c-4de8-b3d1-e497c538bce7 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:55.166908 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7a1389a6-718c-4de8-b3d1-e497c538bce7 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:55.167684 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7a1389a6-718c-4de8-b3d1-e497c538bce7 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:55.168119 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7a1389a6-718c-4de8-b3d1-e497c538bce7 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:55.238017 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-7a1389a6-718c-4de8-b3d1-e497c538bce7 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action" status: 200 len: 21519 microversion: 2.20 time: 0.092287 Nov 23 09:03:55.238647 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 360/721] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:03:55 2021] POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action => generated 21519 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:03:56.249969 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-24f6f7a8-12f0-43ea-bee4-12a15d95db98 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:03:56.250955 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-24f6f7a8-12f0-43ea-bee4-12a15d95db98 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:03:56.257969 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-24f6f7a8-12f0-43ea-bee4-12a15d95db98 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:56.258442 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-24f6f7a8-12f0-43ea-bee4-12a15d95db98 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:56.259186 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-24f6f7a8-12f0-43ea-bee4-12a15d95db98 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:03:56.259616 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-24f6f7a8-12f0-43ea-bee4-12a15d95db98 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:03:58.996277 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-24f6f7a8-12f0-43ea-bee4-12a15d95db98 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action" status: 200 len: 25732 microversion: 2.20 time: 2.750298 Nov 23 09:03:58.996968 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 362/722] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:03:56 2021] POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action => generated 25732 bytes in 2752 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:04:00.008709 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-eb6bf863-1021-4c57-bbf6-228228fe07a0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:04:00.010953 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-eb6bf863-1021-4c57-bbf6-228228fe07a0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:00.018108 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-eb6bf863-1021-4c57-bbf6-228228fe07a0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:00.018566 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-eb6bf863-1021-4c57-bbf6-228228fe07a0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:00.019356 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-eb6bf863-1021-4c57-bbf6-228228fe07a0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:00.019796 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-eb6bf863-1021-4c57-bbf6-228228fe07a0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:00.096842 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-eb6bf863-1021-4c57-bbf6-228228fe07a0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action" status: 200 len: 26938 microversion: 2.20 time: 0.092497 Nov 23 09:04:00.097726 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 361/723] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:04:00 2021] POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action => generated 26938 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:04:01.108364 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a972ed04-e8bd-4c49-b199-db90eb10d75b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:04:01.109460 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a972ed04-e8bd-4c49-b199-db90eb10d75b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:01.116856 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a972ed04-e8bd-4c49-b199-db90eb10d75b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:01.117427 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a972ed04-e8bd-4c49-b199-db90eb10d75b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:01.118431 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a972ed04-e8bd-4c49-b199-db90eb10d75b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:01.118865 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a972ed04-e8bd-4c49-b199-db90eb10d75b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:01.202957 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a972ed04-e8bd-4c49-b199-db90eb10d75b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action" status: 200 len: 27615 microversion: 2.20 time: 0.098558 Nov 23 09:04:01.203840 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 363/724] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:04:01 2021] POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action => generated 27615 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:04:02.215670 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-ae7d5a4c-70d3-4bc5-ac72-524da827112d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:04:02.216671 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-ae7d5a4c-70d3-4bc5-ac72-524da827112d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:02.223656 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ae7d5a4c-70d3-4bc5-ac72-524da827112d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:02.224109 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ae7d5a4c-70d3-4bc5-ac72-524da827112d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:02.224893 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ae7d5a4c-70d3-4bc5-ac72-524da827112d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:02.225381 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ae7d5a4c-70d3-4bc5-ac72-524da827112d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:02.311488 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-ae7d5a4c-70d3-4bc5-ac72-524da827112d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action" status: 200 len: 27968 microversion: 2.20 time: 0.099921 Nov 23 09:04:02.312271 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 362/725] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:04:02 2021] POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action => generated 27968 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:04:03.324663 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-3b985cac-0f77-4695-9345-93dde7a43f4f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:04:03.325676 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-3b985cac-0f77-4695-9345-93dde7a43f4f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:03.332428 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3b985cac-0f77-4695-9345-93dde7a43f4f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:03.332890 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3b985cac-0f77-4695-9345-93dde7a43f4f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:03.333674 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3b985cac-0f77-4695-9345-93dde7a43f4f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:03.334107 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3b985cac-0f77-4695-9345-93dde7a43f4f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:03.411098 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-3b985cac-0f77-4695-9345-93dde7a43f4f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action" status: 200 len: 28221 microversion: 2.20 time: 0.090857 Nov 23 09:04:03.413353 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 364/726] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:04:03 2021] POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action => generated 28221 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:04:04.423317 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-ae3908e1-a53e-4564-bf69-e16dcc8ae128 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:04:04.424295 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-ae3908e1-a53e-4564-bf69-e16dcc8ae128 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:04.431974 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ae3908e1-a53e-4564-bf69-e16dcc8ae128 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:04.432321 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ae3908e1-a53e-4564-bf69-e16dcc8ae128 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:04.433116 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ae3908e1-a53e-4564-bf69-e16dcc8ae128 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:04.433592 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ae3908e1-a53e-4564-bf69-e16dcc8ae128 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:04.496985 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-ae3908e1-a53e-4564-bf69-e16dcc8ae128 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action" status: 200 len: 28221 microversion: 2.20 time: 0.077538 Nov 23 09:04:04.498082 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 363/727] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:04:04 2021] POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action => generated 28221 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:04:05.510373 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-cada3fca-7ba5-4f0f-8224-5caeb44793cb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:04:05.511486 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-cada3fca-7ba5-4f0f-8224-5caeb44793cb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:05.518295 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cada3fca-7ba5-4f0f-8224-5caeb44793cb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:05.518751 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cada3fca-7ba5-4f0f-8224-5caeb44793cb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:05.519680 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cada3fca-7ba5-4f0f-8224-5caeb44793cb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:05.520131 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cada3fca-7ba5-4f0f-8224-5caeb44793cb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:05.582791 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-cada3fca-7ba5-4f0f-8224-5caeb44793cb tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action" status: 200 len: 28221 microversion: 2.20 time: 0.076946 Nov 23 09:04:05.586733 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 365/728] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:04:05 2021] POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action => generated 28221 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:04:06.596344 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-47de3cd9-dee1-4231-beab-22d4bcf798b6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:04:06.598739 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-47de3cd9-dee1-4231-beab-22d4bcf798b6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:06.606171 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-47de3cd9-dee1-4231-beab-22d4bcf798b6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:06.606870 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-47de3cd9-dee1-4231-beab-22d4bcf798b6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:06.607846 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-47de3cd9-dee1-4231-beab-22d4bcf798b6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:06.608445 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-47de3cd9-dee1-4231-beab-22d4bcf798b6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:06.686633 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-47de3cd9-dee1-4231-beab-22d4bcf798b6 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action" status: 200 len: 28512 microversion: 2.20 time: 0.095561 Nov 23 09:04:06.687483 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 364/729] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:04:06 2021] POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action => generated 28512 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:04:07.699618 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-30a35e08-47cd-45eb-88f5-446fd353e5ee tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:04:07.700968 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-30a35e08-47cd-45eb-88f5-446fd353e5ee tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:07.708809 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-30a35e08-47cd-45eb-88f5-446fd353e5ee tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:07.711808 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-30a35e08-47cd-45eb-88f5-446fd353e5ee tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:07.713727 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-30a35e08-47cd-45eb-88f5-446fd353e5ee tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:07.714338 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-30a35e08-47cd-45eb-88f5-446fd353e5ee tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:07.796888 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-30a35e08-47cd-45eb-88f5-446fd353e5ee tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action" status: 200 len: 28680 microversion: 2.20 time: 0.101494 Nov 23 09:04:07.797596 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 366/730] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:04:07 2021] POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action => generated 28680 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:04:08.809956 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-09203ae5-a0cc-4f23-8f7f-319918e7faf8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:04:08.810871 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-09203ae5-a0cc-4f23-8f7f-319918e7faf8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:08.826600 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-09203ae5-a0cc-4f23-8f7f-319918e7faf8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:08.827658 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-09203ae5-a0cc-4f23-8f7f-319918e7faf8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:08.828179 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-09203ae5-a0cc-4f23-8f7f-319918e7faf8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:08.828615 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-09203ae5-a0cc-4f23-8f7f-319918e7faf8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:08.897648 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-09203ae5-a0cc-4f23-8f7f-319918e7faf8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action" status: 200 len: 28680 microversion: 2.20 time: 0.092678 Nov 23 09:04:08.902511 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 365/731] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:04:08 2021] POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action => generated 28680 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:04:09.933134 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-43e21e88-9ee7-4387-a2a9-63c6e1cf4c9b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:04:09.936307 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-43e21e88-9ee7-4387-a2a9-63c6e1cf4c9b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:09.947540 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-43e21e88-9ee7-4387-a2a9-63c6e1cf4c9b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:09.948343 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-43e21e88-9ee7-4387-a2a9-63c6e1cf4c9b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:09.949852 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-43e21e88-9ee7-4387-a2a9-63c6e1cf4c9b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:09.950825 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-43e21e88-9ee7-4387-a2a9-63c6e1cf4c9b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:10.027819 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-43e21e88-9ee7-4387-a2a9-63c6e1cf4c9b tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action" status: 200 len: 28680 microversion: 2.20 time: 0.119830 Nov 23 09:04:10.028657 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 367/732] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:04:09 2021] POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action => generated 28680 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 09:04:11.040853 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-5afd7718-1987-47f3-9669-aada4ba3b33d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:04:11.042709 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-5afd7718-1987-47f3-9669-aada4ba3b33d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:11.052952 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5afd7718-1987-47f3-9669-aada4ba3b33d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:11.053640 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5afd7718-1987-47f3-9669-aada4ba3b33d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:11.054672 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5afd7718-1987-47f3-9669-aada4ba3b33d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:11.055298 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5afd7718-1987-47f3-9669-aada4ba3b33d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:11.150291 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-5afd7718-1987-47f3-9669-aada4ba3b33d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action" status: 200 len: 29624 microversion: 2.20 time: 0.112942 Nov 23 09:04:11.156261 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 366/733] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:04:11 2021] POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action => generated 29624 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:04:12.164929 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-2c3cccc2-b615-49f1-acae-7af0bccd8df2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:04:12.169070 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-2c3cccc2-b615-49f1-acae-7af0bccd8df2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:12.180938 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2c3cccc2-b615-49f1-acae-7af0bccd8df2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:12.181856 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2c3cccc2-b615-49f1-acae-7af0bccd8df2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:12.182851 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2c3cccc2-b615-49f1-acae-7af0bccd8df2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:12.183589 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2c3cccc2-b615-49f1-acae-7af0bccd8df2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:12.263153 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-2c3cccc2-b615-49f1-acae-7af0bccd8df2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action" status: 200 len: 31842 microversion: 2.20 time: 0.103364 Nov 23 09:04:12.264091 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 368/734] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:04:12 2021] POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action => generated 31842 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:04:13.277413 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-9ed4bf17-881e-4f9d-af3a-09c1c089794a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:04:13.278726 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-9ed4bf17-881e-4f9d-af3a-09c1c089794a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:13.291479 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9ed4bf17-881e-4f9d-af3a-09c1c089794a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:13.291928 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9ed4bf17-881e-4f9d-af3a-09c1c089794a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:13.292743 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9ed4bf17-881e-4f9d-af3a-09c1c089794a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:13.293196 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9ed4bf17-881e-4f9d-af3a-09c1c089794a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:13.393010 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-9ed4bf17-881e-4f9d-af3a-09c1c089794a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action" status: 200 len: 33368 microversion: 2.20 time: 0.120108 Nov 23 09:04:13.394050 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 367/735] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:04:13 2021] POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action => generated 33368 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 09:04:14.406024 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-3b15b4b0-57ca-4e1e-bf3f-4c40d8964fff tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:04:14.407590 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-3b15b4b0-57ca-4e1e-bf3f-4c40d8964fff tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:14.414933 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3b15b4b0-57ca-4e1e-bf3f-4c40d8964fff tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:14.415392 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3b15b4b0-57ca-4e1e-bf3f-4c40d8964fff tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:14.416294 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3b15b4b0-57ca-4e1e-bf3f-4c40d8964fff tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:14.416729 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3b15b4b0-57ca-4e1e-bf3f-4c40d8964fff tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:14.501647 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-3b15b4b0-57ca-4e1e-bf3f-4c40d8964fff tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action" status: 200 len: 34356 microversion: 2.20 time: 0.099414 Nov 23 09:04:14.502418 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 369/736] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:04:14 2021] POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action => generated 34356 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 09:04:15.513795 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-6865ef09-49e4-41cb-b904-7dfdff300bb9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:04:15.515009 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-6865ef09-49e4-41cb-b904-7dfdff300bb9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:15.522080 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6865ef09-49e4-41cb-b904-7dfdff300bb9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:15.522536 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6865ef09-49e4-41cb-b904-7dfdff300bb9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:15.523326 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6865ef09-49e4-41cb-b904-7dfdff300bb9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:15.523772 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6865ef09-49e4-41cb-b904-7dfdff300bb9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:15.601750 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-6865ef09-49e4-41cb-b904-7dfdff300bb9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action" status: 200 len: 35538 microversion: 2.20 time: 0.091869 Nov 23 09:04:15.602860 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 368/737] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:04:15 2021] POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action => generated 35538 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:04:16.615486 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-9e152448-b136-46be-a2f5-fa8014643ad4 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:04:16.617067 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-9e152448-b136-46be-a2f5-fa8014643ad4 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:16.628871 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9e152448-b136-46be-a2f5-fa8014643ad4 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:16.629599 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9e152448-b136-46be-a2f5-fa8014643ad4 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:16.630573 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9e152448-b136-46be-a2f5-fa8014643ad4 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:16.631163 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9e152448-b136-46be-a2f5-fa8014643ad4 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:16.719987 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-9e152448-b136-46be-a2f5-fa8014643ad4 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action" status: 200 len: 37055 microversion: 2.20 time: 0.108713 Nov 23 09:04:16.720885 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 370/738] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:04:16 2021] POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action => generated 37055 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:04:17.732464 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-5b4b5a2e-eeb4-4983-abfa-fa0006bde52d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:04:17.733694 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-5b4b5a2e-eeb4-4983-abfa-fa0006bde52d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:17.741002 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5b4b5a2e-eeb4-4983-abfa-fa0006bde52d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:17.741481 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5b4b5a2e-eeb4-4983-abfa-fa0006bde52d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:17.742309 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5b4b5a2e-eeb4-4983-abfa-fa0006bde52d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:17.742868 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5b4b5a2e-eeb4-4983-abfa-fa0006bde52d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:17.824905 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-5b4b5a2e-eeb4-4983-abfa-fa0006bde52d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action" status: 200 len: 38235 microversion: 2.20 time: 0.096409 Nov 23 09:04:17.825759 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 369/739] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:04:17 2021] POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action => generated 38235 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:04:18.840769 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-4d6fb882-d428-4576-bee3-63f8f0f3b14c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:04:18.841826 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-4d6fb882-d428-4576-bee3-63f8f0f3b14c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:18.856145 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4d6fb882-d428-4576-bee3-63f8f0f3b14c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:18.856914 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4d6fb882-d428-4576-bee3-63f8f0f3b14c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:18.858100 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4d6fb882-d428-4576-bee3-63f8f0f3b14c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:18.861743 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4d6fb882-d428-4576-bee3-63f8f0f3b14c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:18.966531 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-4d6fb882-d428-4576-bee3-63f8f0f3b14c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action" status: 200 len: 38235 microversion: 2.20 time: 0.130796 Nov 23 09:04:18.974772 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 371/740] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:04:18 2021] POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action => generated 38235 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:04:19.980632 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-dd93fc92-fa13-4ffa-93d3-ed968f45523a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:04:19.982467 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-dd93fc92-fa13-4ffa-93d3-ed968f45523a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:19.989646 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-dd93fc92-fa13-4ffa-93d3-ed968f45523a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:19.990383 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-dd93fc92-fa13-4ffa-93d3-ed968f45523a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:19.991404 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-dd93fc92-fa13-4ffa-93d3-ed968f45523a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:19.992057 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-dd93fc92-fa13-4ffa-93d3-ed968f45523a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:20.053197 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-dd93fc92-fa13-4ffa-93d3-ed968f45523a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action" status: 200 len: 38235 microversion: 2.20 time: 0.076559 Nov 23 09:04:20.054251 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 370/741] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:04:19 2021] POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action => generated 38235 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:04:21.066838 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e0c7087e-1f08-43f4-a8f4-6b45741aca31 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:04:21.067837 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e0c7087e-1f08-43f4-a8f4-6b45741aca31 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:21.075280 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e0c7087e-1f08-43f4-a8f4-6b45741aca31 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:21.076049 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e0c7087e-1f08-43f4-a8f4-6b45741aca31 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:21.077119 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e0c7087e-1f08-43f4-a8f4-6b45741aca31 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:21.077586 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e0c7087e-1f08-43f4-a8f4-6b45741aca31 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:21.151185 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e0c7087e-1f08-43f4-a8f4-6b45741aca31 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action" status: 200 len: 38235 microversion: 2.20 time: 0.088192 Nov 23 09:04:21.151880 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 372/742] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:04:21 2021] POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action => generated 38235 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:04:22.164086 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-9ce957dc-149e-4d7d-99f6-7d5fcc13e693 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:04:22.166469 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-9ce957dc-149e-4d7d-99f6-7d5fcc13e693 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:22.173236 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9ce957dc-149e-4d7d-99f6-7d5fcc13e693 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:22.174004 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9ce957dc-149e-4d7d-99f6-7d5fcc13e693 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:22.174860 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9ce957dc-149e-4d7d-99f6-7d5fcc13e693 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:22.175525 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9ce957dc-149e-4d7d-99f6-7d5fcc13e693 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:22.248156 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-9ce957dc-149e-4d7d-99f6-7d5fcc13e693 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action" status: 200 len: 38376 microversion: 2.20 time: 0.087950 Nov 23 09:04:22.249156 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 371/743] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:04:22 2021] POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action => generated 38376 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 09:04:22.261569 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a3f10705-6010-4e2a-aabf-461c3e7e177e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:22.261569 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a3f10705-6010-4e2a-aabf-461c3e7e177e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:22.267926 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a3f10705-6010-4e2a-aabf-461c3e7e177e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:22.268377 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a3f10705-6010-4e2a-aabf-461c3e7e177e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:22.269479 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a3f10705-6010-4e2a-aabf-461c3e7e177e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:22.270203 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a3f10705-6010-4e2a-aabf-461c3e7e177e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:22.296170 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a3f10705-6010-4e2a-aabf-461c3e7e177e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/ips" status: 200 len: 151 microversion: 2.20 time: 0.040633 Nov 23 09:04:22.296759 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 373/744] 10.222.0.46 () {60 vars in 1288 bytes} [Tue Nov 23 09:04:22 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:04:24.410487 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-643f2f62-c4b8-4a55-978b-24cd2b71c49f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:04:24.411106 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-643f2f62-c4b8-4a55-978b-24cd2b71c49f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:24.418599 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-643f2f62-c4b8-4a55-978b-24cd2b71c49f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:24.419052 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-643f2f62-c4b8-4a55-978b-24cd2b71c49f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:24.419839 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-643f2f62-c4b8-4a55-978b-24cd2b71c49f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:24.420278 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-643f2f62-c4b8-4a55-978b-24cd2b71c49f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:24.447503 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.objects.instance [None req-643f2f62-c4b8-4a55-978b-24cd2b71c49f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lazy-loading 'flavor' on Instance uuid 33d3a8a8-651e-4b5e-ac3a-2032c9d60800 {{(pid=116227) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 09:04:24.512470 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-0f4082aa-5772-4d69-b161-f593515492a8 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Action: 'create', calling method: .version_select at 0x7f527a35dca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-516894904"}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:04:24.526668 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-0f4082aa-5772-4d69-b161-f593515492a8 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Getting quotas for project 5d37eeef32a14dfcad683356d32556e8. Resources: {'key_pairs'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 09:04:24.530423 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-0f4082aa-5772-4d69-b161-f593515492a8 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Getting quotas for user f8695df9b3784afc8998af34694b942b and project 5d37eeef32a14dfcad683356d32556e8. Resources: {'key_pairs'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 09:04:24.637229 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-0f4082aa-5772-4d69-b161-f593515492a8 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Getting quotas for project 5d37eeef32a14dfcad683356d32556e8. Resources: {'key_pairs'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 09:04:24.641029 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-0f4082aa-5772-4d69-b161-f593515492a8 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Getting quotas for user f8695df9b3784afc8998af34694b942b and project 5d37eeef32a14dfcad683356d32556e8. Resources: {'key_pairs'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 09:04:24.654797 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-0f4082aa-5772-4d69-b161-f593515492a8 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.147118 Nov 23 09:04:24.655401 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 374/745] 10.222.0.46 () {60 vars in 1157 bytes} [Tue Nov 23 09:04:24 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:04:24.706354 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-643f2f62-c4b8-4a55-978b-24cd2b71c49f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action" status: 202 len: 0 microversion: 2.20 time: 0.299807 Nov 23 09:04:24.706989 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 372/746] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:04:24 2021] POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 23 09:04:24.708278 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-4d7f3296-56cd-47aa-ab5c-dcfc8e2945b8 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-285589269", "imageRef": "03f9783d-42fe-4b6f-a05a-1b05e185e563", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-516894904", "networks": [{"uuid": "e4a1cde7-6f6b-4ecd-a6b9-780394a99cb4"}]}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:04:24.715226 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-d81e1840-49fe-496a-a62a-2aa2ae994320 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:24.716053 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-d81e1840-49fe-496a-a62a-2aa2ae994320 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:24.723163 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d81e1840-49fe-496a-a62a-2aa2ae994320 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:24.723676 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d81e1840-49fe-496a-a62a-2aa2ae994320 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:24.724549 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d81e1840-49fe-496a-a62a-2aa2ae994320 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:24.725044 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d81e1840-49fe-496a-a62a-2aa2ae994320 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:24.762887 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.network.neutron [None req-4d7f3296-56cd-47aa-ab5c-dcfc8e2945b8 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] validate_networks() for [('e4a1cde7-6f6b-4ecd-a6b9-780394a99cb4', None, None, None, None, None)] {{(pid=116226) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 09:04:24.873017 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-d81e1840-49fe-496a-a62a-2aa2ae994320 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:24.881048 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-d81e1840-49fe-496a-a62a-2aa2ae994320 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:24.882618 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-d81e1840-49fe-496a-a62a-2aa2ae994320 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:24.884428 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-d81e1840-49fe-496a-a62a-2aa2ae994320 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1722 microversion: 2.20 time: 0.173291 Nov 23 09:04:24.884995 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 373/747] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:04:24 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 09:04:25.222724 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-4d7f3296-56cd-47aa-ab5c-dcfc8e2945b8 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Flavor limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 09:04:25.223145 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-4d7f3296-56cd-47aa-ab5c-dcfc8e2945b8 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Image limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 09:04:25.223612 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-4d7f3296-56cd-47aa-ab5c-dcfc8e2945b8 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Flavor pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 09:04:25.224021 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-4d7f3296-56cd-47aa-ab5c-dcfc8e2945b8 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Image pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 09:04:25.224426 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-4d7f3296-56cd-47aa-ab5c-dcfc8e2945b8 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 09:04:25.233405 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4d7f3296-56cd-47aa-ab5c-dcfc8e2945b8 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:25.233849 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4d7f3296-56cd-47aa-ab5c-dcfc8e2945b8 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:25.234684 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4d7f3296-56cd-47aa-ab5c-dcfc8e2945b8 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:25.235117 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4d7f3296-56cd-47aa-ab5c-dcfc8e2945b8 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:25.251655 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-4d7f3296-56cd-47aa-ab5c-dcfc8e2945b8 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Getting quotas for project 5d37eeef32a14dfcad683356d32556e8. Resources: {'instances', 'ram', 'cores'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 09:04:25.255475 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-4d7f3296-56cd-47aa-ab5c-dcfc8e2945b8 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Getting quotas for user f8695df9b3784afc8998af34694b942b and project 5d37eeef32a14dfcad683356d32556e8. Resources: {'instances', 'ram', 'cores'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 09:04:25.265791 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-4d7f3296-56cd-47aa-ab5c-dcfc8e2945b8 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Going to run 1 instances... {{(pid=116226) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 09:04:25.267949 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-4d7f3296-56cd-47aa-ab5c-dcfc8e2945b8 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='03f9783d-42fe-4b6f-a05a-1b05e185e563',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116226) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 09:04:25.314226 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-4d7f3296-56cd-47aa-ab5c-dcfc8e2945b8 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.610787 Nov 23 09:04:25.315028 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 375/748] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 23 09:04:24 2021] POST /compute/v2.1/servers => generated 380 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 23 09:04:25.326728 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-3f3ae3dc-28c6-4448-93b0-abb3239e7b34 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:25.327317 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-3f3ae3dc-28c6-4448-93b0-abb3239e7b34 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:25.381309 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-3f3ae3dc-28c6-4448-93b0-abb3239e7b34 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8695df9b3784afc8998af34694b942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d37eeef32a14dfcad683356d32556e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:25.387836 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-3f3ae3dc-28c6-4448-93b0-abb3239e7b34 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84" status: 200 len: 1257 microversion: 2.1 time: 0.065401 Nov 23 09:04:25.388403 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 374/749] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:04:25 2021] GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84 => generated 1257 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:04:25.903260 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-30c4e34c-6e36-4c75-b462-f92d27715e4e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:25.903868 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-30c4e34c-6e36-4c75-b462-f92d27715e4e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:25.910226 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-30c4e34c-6e36-4c75-b462-f92d27715e4e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:25.910706 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-30c4e34c-6e36-4c75-b462-f92d27715e4e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:25.911511 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-30c4e34c-6e36-4c75-b462-f92d27715e4e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:25.911950 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-30c4e34c-6e36-4c75-b462-f92d27715e4e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:26.048987 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-30c4e34c-6e36-4c75-b462-f92d27715e4e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:26.057517 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-30c4e34c-6e36-4c75-b462-f92d27715e4e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:26.059014 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-30c4e34c-6e36-4c75-b462-f92d27715e4e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:26.060163 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-30c4e34c-6e36-4c75-b462-f92d27715e4e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1722 microversion: 2.20 time: 0.161344 Nov 23 09:04:26.060724 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 376/750] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:04:25 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:04:26.406016 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-b5411dda-a352-4ad0-8774-c3dffbee6d8a tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:26.407296 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-b5411dda-a352-4ad0-8774-c3dffbee6d8a tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:26.415232 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b5411dda-a352-4ad0-8774-c3dffbee6d8a tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:26.415846 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b5411dda-a352-4ad0-8774-c3dffbee6d8a tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:26.417080 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b5411dda-a352-4ad0-8774-c3dffbee6d8a tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:26.417546 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b5411dda-a352-4ad0-8774-c3dffbee6d8a tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:26.502456 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-b5411dda-a352-4ad0-8774-c3dffbee6d8a tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8695df9b3784afc8998af34694b942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d37eeef32a14dfcad683356d32556e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:26.516169 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-b5411dda-a352-4ad0-8774-c3dffbee6d8a tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84" status: 200 len: 1327 microversion: 2.1 time: 0.113947 Nov 23 09:04:26.516995 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 375/751] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:04:26 2021] GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84 => generated 1327 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:04:27.079045 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-88e75ed5-3d49-4d13-b335-09ee51c25ecc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:27.080471 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-88e75ed5-3d49-4d13-b335-09ee51c25ecc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:27.101086 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-88e75ed5-3d49-4d13-b335-09ee51c25ecc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:27.102175 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-88e75ed5-3d49-4d13-b335-09ee51c25ecc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:27.103637 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-88e75ed5-3d49-4d13-b335-09ee51c25ecc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:27.104248 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-88e75ed5-3d49-4d13-b335-09ee51c25ecc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:27.288706 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-88e75ed5-3d49-4d13-b335-09ee51c25ecc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:27.304638 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-88e75ed5-3d49-4d13-b335-09ee51c25ecc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:27.306760 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-88e75ed5-3d49-4d13-b335-09ee51c25ecc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:27.307968 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-88e75ed5-3d49-4d13-b335-09ee51c25ecc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1722 microversion: 2.20 time: 0.232589 Nov 23 09:04:27.308530 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 377/752] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:04:27 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:04:27.534565 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-d28e6d65-75e2-453a-8086-6b107bf19433 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:27.536518 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-d28e6d65-75e2-453a-8086-6b107bf19433 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:27.543815 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d28e6d65-75e2-453a-8086-6b107bf19433 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:27.544798 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d28e6d65-75e2-453a-8086-6b107bf19433 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:27.545888 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d28e6d65-75e2-453a-8086-6b107bf19433 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:27.546568 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d28e6d65-75e2-453a-8086-6b107bf19433 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:27.678788 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-d28e6d65-75e2-453a-8086-6b107bf19433 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8695df9b3784afc8998af34694b942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d37eeef32a14dfcad683356d32556e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:27.687531 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-d28e6d65-75e2-453a-8086-6b107bf19433 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84" status: 200 len: 1357 microversion: 2.1 time: 0.156652 Nov 23 09:04:27.688305 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 376/753] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:04:27 2021] GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:04:28.327695 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-7c4cb225-d3f4-47be-b1c7-8ab0fb188fa1 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:28.329035 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-7c4cb225-d3f4-47be-b1c7-8ab0fb188fa1 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:28.335893 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7c4cb225-d3f4-47be-b1c7-8ab0fb188fa1 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:28.336340 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7c4cb225-d3f4-47be-b1c7-8ab0fb188fa1 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:28.337634 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7c4cb225-d3f4-47be-b1c7-8ab0fb188fa1 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:28.338065 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7c4cb225-d3f4-47be-b1c7-8ab0fb188fa1 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:28.473037 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-7c4cb225-d3f4-47be-b1c7-8ab0fb188fa1 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:28.483203 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-7c4cb225-d3f4-47be-b1c7-8ab0fb188fa1 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:28.484701 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-7c4cb225-d3f4-47be-b1c7-8ab0fb188fa1 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:28.485906 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-7c4cb225-d3f4-47be-b1c7-8ab0fb188fa1 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1722 microversion: 2.20 time: 0.162457 Nov 23 09:04:28.486474 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 378/754] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:04:28 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:04:28.705482 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-ad98d84b-ee1f-4a17-856d-95ce7a627f59 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:28.706003 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-ad98d84b-ee1f-4a17-856d-95ce7a627f59 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:28.712981 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ad98d84b-ee1f-4a17-856d-95ce7a627f59 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:28.713462 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ad98d84b-ee1f-4a17-856d-95ce7a627f59 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:28.714231 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ad98d84b-ee1f-4a17-856d-95ce7a627f59 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:28.714662 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ad98d84b-ee1f-4a17-856d-95ce7a627f59 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:28.863669 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-ad98d84b-ee1f-4a17-856d-95ce7a627f59 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8695df9b3784afc8998af34694b942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d37eeef32a14dfcad683356d32556e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:28.872149 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-ad98d84b-ee1f-4a17-856d-95ce7a627f59 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84" status: 200 len: 1357 microversion: 2.1 time: 0.170501 Nov 23 09:04:28.872720 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 377/755] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:04:28 2021] GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84 => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:04:29.503621 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-068df5dc-0403-4da7-a620-5866e7ff8e98 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:29.504180 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-068df5dc-0403-4da7-a620-5866e7ff8e98 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:29.511534 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-068df5dc-0403-4da7-a620-5866e7ff8e98 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:29.511989 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-068df5dc-0403-4da7-a620-5866e7ff8e98 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:29.512780 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-068df5dc-0403-4da7-a620-5866e7ff8e98 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:29.513235 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-068df5dc-0403-4da7-a620-5866e7ff8e98 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:29.666836 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-068df5dc-0403-4da7-a620-5866e7ff8e98 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:29.685712 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-068df5dc-0403-4da7-a620-5866e7ff8e98 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:29.688871 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-068df5dc-0403-4da7-a620-5866e7ff8e98 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:29.690948 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-068df5dc-0403-4da7-a620-5866e7ff8e98 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1722 microversion: 2.20 time: 0.190806 Nov 23 09:04:29.691962 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 379/756] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:04:29 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:04:29.889684 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-2e6dd2da-eae2-43e3-b5bb-014fb8dfcd5a tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:29.891332 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-2e6dd2da-eae2-43e3-b5bb-014fb8dfcd5a tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:29.899323 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2e6dd2da-eae2-43e3-b5bb-014fb8dfcd5a tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:29.900137 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2e6dd2da-eae2-43e3-b5bb-014fb8dfcd5a tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:29.900940 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2e6dd2da-eae2-43e3-b5bb-014fb8dfcd5a tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:29.901685 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2e6dd2da-eae2-43e3-b5bb-014fb8dfcd5a tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:30.034822 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-2e6dd2da-eae2-43e3-b5bb-014fb8dfcd5a tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8695df9b3784afc8998af34694b942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d37eeef32a14dfcad683356d32556e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:30.043391 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-2e6dd2da-eae2-43e3-b5bb-014fb8dfcd5a tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84" status: 200 len: 1357 microversion: 2.1 time: 0.157813 Nov 23 09:04:30.044297 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 378/757] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:04:29 2021] GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:04:30.713302 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-26ef1619-cfe2-4977-9dfa-6da7e9ac7600 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:30.714926 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-26ef1619-cfe2-4977-9dfa-6da7e9ac7600 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:30.721309 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-26ef1619-cfe2-4977-9dfa-6da7e9ac7600 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:30.721758 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-26ef1619-cfe2-4977-9dfa-6da7e9ac7600 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:30.722537 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-26ef1619-cfe2-4977-9dfa-6da7e9ac7600 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:30.723286 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-26ef1619-cfe2-4977-9dfa-6da7e9ac7600 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:30.862103 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-26ef1619-cfe2-4977-9dfa-6da7e9ac7600 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:30.870461 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-26ef1619-cfe2-4977-9dfa-6da7e9ac7600 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:30.871957 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-26ef1619-cfe2-4977-9dfa-6da7e9ac7600 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:30.873116 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-26ef1619-cfe2-4977-9dfa-6da7e9ac7600 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1722 microversion: 2.20 time: 0.164776 Nov 23 09:04:30.873738 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 380/758] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:04:30 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:04:31.063386 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-ce3464b2-6d00-4d10-a459-8b86e0e749cf tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:31.064172 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-ce3464b2-6d00-4d10-a459-8b86e0e749cf tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:31.070750 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ce3464b2-6d00-4d10-a459-8b86e0e749cf tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:31.071237 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ce3464b2-6d00-4d10-a459-8b86e0e749cf tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:31.072077 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ce3464b2-6d00-4d10-a459-8b86e0e749cf tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:31.072565 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ce3464b2-6d00-4d10-a459-8b86e0e749cf tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:31.209585 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-ce3464b2-6d00-4d10-a459-8b86e0e749cf tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8695df9b3784afc8998af34694b942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d37eeef32a14dfcad683356d32556e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:31.219304 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-ce3464b2-6d00-4d10-a459-8b86e0e749cf tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84" status: 200 len: 1357 microversion: 2.1 time: 0.162316 Nov 23 09:04:31.230902 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 379/759] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:04:31 2021] GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84 => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:04:31.891043 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-88386cfa-9778-4eda-b688-c7489aa0ed63 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:31.891670 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-88386cfa-9778-4eda-b688-c7489aa0ed63 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:31.897813 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-88386cfa-9778-4eda-b688-c7489aa0ed63 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:31.898264 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-88386cfa-9778-4eda-b688-c7489aa0ed63 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:31.899823 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-88386cfa-9778-4eda-b688-c7489aa0ed63 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:31.900255 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-88386cfa-9778-4eda-b688-c7489aa0ed63 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:32.044325 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-88386cfa-9778-4eda-b688-c7489aa0ed63 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:32.052388 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-88386cfa-9778-4eda-b688-c7489aa0ed63 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:32.053904 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-88386cfa-9778-4eda-b688-c7489aa0ed63 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:32.055046 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-88386cfa-9778-4eda-b688-c7489aa0ed63 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1722 microversion: 2.20 time: 0.167701 Nov 23 09:04:32.055604 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 381/760] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:04:31 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:04:32.237931 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-8727c22a-c479-4901-b59b-9ff806dc35db tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:32.239397 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-8727c22a-c479-4901-b59b-9ff806dc35db tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:32.247004 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8727c22a-c479-4901-b59b-9ff806dc35db tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:32.247485 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8727c22a-c479-4901-b59b-9ff806dc35db tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:32.248276 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8727c22a-c479-4901-b59b-9ff806dc35db tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:32.248704 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8727c22a-c479-4901-b59b-9ff806dc35db tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:32.387503 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-8727c22a-c479-4901-b59b-9ff806dc35db tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8695df9b3784afc8998af34694b942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d37eeef32a14dfcad683356d32556e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:32.394956 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-8727c22a-c479-4901-b59b-9ff806dc35db tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84" status: 200 len: 1357 microversion: 2.1 time: 0.161361 Nov 23 09:04:32.395533 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 380/761] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:04:32 2021] GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:04:33.074330 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c1889192-777a-425f-b578-c1f7226c0cb9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:33.075203 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c1889192-777a-425f-b578-c1f7226c0cb9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:33.081421 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c1889192-777a-425f-b578-c1f7226c0cb9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:33.081886 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c1889192-777a-425f-b578-c1f7226c0cb9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:33.082668 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c1889192-777a-425f-b578-c1f7226c0cb9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:33.083099 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c1889192-777a-425f-b578-c1f7226c0cb9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:33.224532 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-c1889192-777a-425f-b578-c1f7226c0cb9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:33.232116 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-c1889192-777a-425f-b578-c1f7226c0cb9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:33.233640 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-c1889192-777a-425f-b578-c1f7226c0cb9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:33.234778 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c1889192-777a-425f-b578-c1f7226c0cb9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1722 microversion: 2.20 time: 0.164891 Nov 23 09:04:33.235333 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 382/762] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:04:33 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:04:33.416805 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-6ccade3d-b74a-4262-bd40-6f405dc313ed tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:33.417433 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-6ccade3d-b74a-4262-bd40-6f405dc313ed tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:33.423753 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6ccade3d-b74a-4262-bd40-6f405dc313ed tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:33.424156 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6ccade3d-b74a-4262-bd40-6f405dc313ed tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:33.424934 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6ccade3d-b74a-4262-bd40-6f405dc313ed tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:33.425396 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6ccade3d-b74a-4262-bd40-6f405dc313ed tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:33.565521 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-6ccade3d-b74a-4262-bd40-6f405dc313ed tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8695df9b3784afc8998af34694b942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d37eeef32a14dfcad683356d32556e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:33.573631 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-6ccade3d-b74a-4262-bd40-6f405dc313ed tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84" status: 200 len: 1357 microversion: 2.1 time: 0.162520 Nov 23 09:04:33.574223 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 381/763] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:04:33 2021] GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:04:34.253579 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-790bfed1-e39c-408b-8fbe-da79c1709a88 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:34.254181 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-790bfed1-e39c-408b-8fbe-da79c1709a88 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:34.260550 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-790bfed1-e39c-408b-8fbe-da79c1709a88 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:34.261000 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-790bfed1-e39c-408b-8fbe-da79c1709a88 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:34.261835 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-790bfed1-e39c-408b-8fbe-da79c1709a88 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:34.262268 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-790bfed1-e39c-408b-8fbe-da79c1709a88 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:34.397964 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-790bfed1-e39c-408b-8fbe-da79c1709a88 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:34.407077 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-790bfed1-e39c-408b-8fbe-da79c1709a88 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:34.408567 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-790bfed1-e39c-408b-8fbe-da79c1709a88 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:34.409787 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-790bfed1-e39c-408b-8fbe-da79c1709a88 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1722 microversion: 2.20 time: 0.159988 Nov 23 09:04:34.410371 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 383/764] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:04:34 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:04:34.591753 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-74715cc7-47ae-4593-bad9-dabc85d3114e tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:34.592635 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-74715cc7-47ae-4593-bad9-dabc85d3114e tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:34.599075 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-74715cc7-47ae-4593-bad9-dabc85d3114e tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:34.599535 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-74715cc7-47ae-4593-bad9-dabc85d3114e tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:34.600333 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-74715cc7-47ae-4593-bad9-dabc85d3114e tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:34.600779 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-74715cc7-47ae-4593-bad9-dabc85d3114e tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:34.742331 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-74715cc7-47ae-4593-bad9-dabc85d3114e tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8695df9b3784afc8998af34694b942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d37eeef32a14dfcad683356d32556e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:34.749647 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-74715cc7-47ae-4593-bad9-dabc85d3114e tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84" status: 200 len: 1357 microversion: 2.1 time: 0.162089 Nov 23 09:04:34.750216 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 382/765] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:04:34 2021] GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:04:35.428486 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-fec120de-cabc-498b-9e2c-7a1aa387a2d9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:35.429099 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-fec120de-cabc-498b-9e2c-7a1aa387a2d9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:35.436492 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fec120de-cabc-498b-9e2c-7a1aa387a2d9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:35.437120 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fec120de-cabc-498b-9e2c-7a1aa387a2d9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:35.437924 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fec120de-cabc-498b-9e2c-7a1aa387a2d9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:35.438731 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fec120de-cabc-498b-9e2c-7a1aa387a2d9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:35.587814 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-fec120de-cabc-498b-9e2c-7a1aa387a2d9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:35.595884 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-fec120de-cabc-498b-9e2c-7a1aa387a2d9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:35.597472 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-fec120de-cabc-498b-9e2c-7a1aa387a2d9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:35.598626 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-fec120de-cabc-498b-9e2c-7a1aa387a2d9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1722 microversion: 2.20 time: 0.173840 Nov 23 09:04:35.599225 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 384/766] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:04:35 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:04:35.767883 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-bac0d6d5-23ac-4356-889f-ce8be9be6d27 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:35.768622 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-bac0d6d5-23ac-4356-889f-ce8be9be6d27 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:35.775703 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-bac0d6d5-23ac-4356-889f-ce8be9be6d27 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:35.776150 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-bac0d6d5-23ac-4356-889f-ce8be9be6d27 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:35.776930 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-bac0d6d5-23ac-4356-889f-ce8be9be6d27 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:35.777399 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-bac0d6d5-23ac-4356-889f-ce8be9be6d27 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:35.909717 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-bac0d6d5-23ac-4356-889f-ce8be9be6d27 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8695df9b3784afc8998af34694b942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d37eeef32a14dfcad683356d32556e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:35.917184 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-bac0d6d5-23ac-4356-889f-ce8be9be6d27 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84" status: 200 len: 1357 microversion: 2.1 time: 0.153342 Nov 23 09:04:35.917790 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 383/767] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:04:35 2021] GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:04:36.640657 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-5dde0169-2ff1-474f-8376-32d879b6c49d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:36.645305 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-5dde0169-2ff1-474f-8376-32d879b6c49d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:36.653019 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5dde0169-2ff1-474f-8376-32d879b6c49d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:36.653510 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5dde0169-2ff1-474f-8376-32d879b6c49d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:36.654385 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5dde0169-2ff1-474f-8376-32d879b6c49d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:36.654829 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5dde0169-2ff1-474f-8376-32d879b6c49d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:36.809674 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-5dde0169-2ff1-474f-8376-32d879b6c49d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:36.817315 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-5dde0169-2ff1-474f-8376-32d879b6c49d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:36.818799 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-5dde0169-2ff1-474f-8376-32d879b6c49d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:36.819969 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-5dde0169-2ff1-474f-8376-32d879b6c49d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1722 microversion: 2.20 time: 0.191094 Nov 23 09:04:36.820611 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 385/768] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:04:36 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:04:36.934377 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-6c4994bf-d8ee-440d-bc74-fca698a2e5e6 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:36.934944 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-6c4994bf-d8ee-440d-bc74-fca698a2e5e6 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:36.941458 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6c4994bf-d8ee-440d-bc74-fca698a2e5e6 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:36.941916 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6c4994bf-d8ee-440d-bc74-fca698a2e5e6 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:36.942696 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6c4994bf-d8ee-440d-bc74-fca698a2e5e6 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:36.943131 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6c4994bf-d8ee-440d-bc74-fca698a2e5e6 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:37.076780 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-6c4994bf-d8ee-440d-bc74-fca698a2e5e6 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8695df9b3784afc8998af34694b942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d37eeef32a14dfcad683356d32556e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:37.084047 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-6c4994bf-d8ee-440d-bc74-fca698a2e5e6 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84" status: 200 len: 1357 microversion: 2.1 time: 0.153619 Nov 23 09:04:37.084621 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 384/769] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:04:36 2021] GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:04:37.838760 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a265bb81-7f59-4101-b4e0-1697e33b030f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:37.839454 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a265bb81-7f59-4101-b4e0-1697e33b030f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:37.845948 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a265bb81-7f59-4101-b4e0-1697e33b030f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:37.847176 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a265bb81-7f59-4101-b4e0-1697e33b030f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:37.847518 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a265bb81-7f59-4101-b4e0-1697e33b030f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:37.847949 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a265bb81-7f59-4101-b4e0-1697e33b030f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:38.005117 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a265bb81-7f59-4101-b4e0-1697e33b030f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:38.013026 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a265bb81-7f59-4101-b4e0-1697e33b030f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:38.014573 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a265bb81-7f59-4101-b4e0-1697e33b030f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:38.015781 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a265bb81-7f59-4101-b4e0-1697e33b030f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1743 microversion: 2.20 time: 0.181495 Nov 23 09:04:38.016349 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 386/770] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:04:37 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1743 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:04:38.104458 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-2bc418ad-d330-46fa-9424-b24919ddfaf8 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:38.105424 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-2bc418ad-d330-46fa-9424-b24919ddfaf8 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:38.113108 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2bc418ad-d330-46fa-9424-b24919ddfaf8 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:38.113909 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2bc418ad-d330-46fa-9424-b24919ddfaf8 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:38.115172 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2bc418ad-d330-46fa-9424-b24919ddfaf8 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:38.115795 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2bc418ad-d330-46fa-9424-b24919ddfaf8 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:38.230274 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-331a8512-113a-493d-b990-198466ba656e req-22424e62-c15a-4d53-b291-643be58d9be9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b24efc8-4126-486b-92cf-3975dc60bd84", "tag": "c2e5dcf0-fb18-4cc4-9002-cb7aa635b9b7"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:04:38.231957 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:04:38.231957 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 09:04:38.240241 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-331a8512-113a-493d-b990-198466ba656e req-22424e62-c15a-4d53-b291-643be58d9be9 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:38.240701 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-331a8512-113a-493d-b990-198466ba656e req-22424e62-c15a-4d53-b291-643be58d9be9 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:38.255903 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-331a8512-113a-493d-b990-198466ba656e req-22424e62-c15a-4d53-b291-643be58d9be9 service nova] Creating event network-changed:c2e5dcf0-fb18-4cc4-9002-cb7aa635b9b7 for instance 0b24efc8-4126-486b-92cf-3975dc60bd84 on hv-cinder-76845 Nov 23 09:04:38.261573 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-331a8512-113a-493d-b990-198466ba656e req-22424e62-c15a-4d53-b291-643be58d9be9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184392 Nov 23 09:04:38.262541 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 385/771] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:04:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:04:38.291438 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-2bc418ad-d330-46fa-9424-b24919ddfaf8 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8695df9b3784afc8998af34694b942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d37eeef32a14dfcad683356d32556e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:38.298712 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-2bc418ad-d330-46fa-9424-b24919ddfaf8 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84" status: 200 len: 1357 microversion: 2.1 time: 0.199337 Nov 23 09:04:38.299589 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 387/772] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:04:38 2021] GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84 => generated 1357 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:04:39.034786 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-b2d97c3b-cd72-4e61-a806-c07d76f38dab tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:39.035564 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-b2d97c3b-cd72-4e61-a806-c07d76f38dab tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:39.042754 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b2d97c3b-cd72-4e61-a806-c07d76f38dab tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:39.043275 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b2d97c3b-cd72-4e61-a806-c07d76f38dab tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:39.044194 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b2d97c3b-cd72-4e61-a806-c07d76f38dab tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:39.044739 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b2d97c3b-cd72-4e61-a806-c07d76f38dab tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:39.190771 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-b2d97c3b-cd72-4e61-a806-c07d76f38dab tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:39.198782 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-b2d97c3b-cd72-4e61-a806-c07d76f38dab tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:39.200250 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-b2d97c3b-cd72-4e61-a806-c07d76f38dab tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:39.201467 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-b2d97c3b-cd72-4e61-a806-c07d76f38dab tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1743 microversion: 2.20 time: 0.170941 Nov 23 09:04:39.202037 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 386/773] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:04:39 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1743 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 09:04:39.315694 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-75355629-38cd-4104-af9a-e5f7eb59b85b tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:39.316464 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-75355629-38cd-4104-af9a-e5f7eb59b85b tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:39.323753 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-75355629-38cd-4104-af9a-e5f7eb59b85b tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:39.324213 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-75355629-38cd-4104-af9a-e5f7eb59b85b tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:39.324998 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-75355629-38cd-4104-af9a-e5f7eb59b85b tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:39.325461 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-75355629-38cd-4104-af9a-e5f7eb59b85b tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:39.453004 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-75355629-38cd-4104-af9a-e5f7eb59b85b tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8695df9b3784afc8998af34694b942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d37eeef32a14dfcad683356d32556e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:39.460202 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-75355629-38cd-4104-af9a-e5f7eb59b85b tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84" status: 200 len: 1357 microversion: 2.1 time: 0.148171 Nov 23 09:04:39.461871 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 388/774] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:04:39 2021] GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:04:40.221464 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-f732019b-6173-44b4-b31f-775bce05f75e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:40.222074 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-f732019b-6173-44b4-b31f-775bce05f75e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:40.229335 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f732019b-6173-44b4-b31f-775bce05f75e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:40.229998 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f732019b-6173-44b4-b31f-775bce05f75e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:40.234686 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f732019b-6173-44b4-b31f-775bce05f75e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:40.235612 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f732019b-6173-44b4-b31f-775bce05f75e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:40.396972 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-f732019b-6173-44b4-b31f-775bce05f75e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:40.408046 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-f732019b-6173-44b4-b31f-775bce05f75e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:40.409561 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-f732019b-6173-44b4-b31f-775bce05f75e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:40.410720 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-f732019b-6173-44b4-b31f-775bce05f75e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1738 microversion: 2.20 time: 0.193528 Nov 23 09:04:40.411773 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 387/775] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:04:40 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1738 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:04:40.480317 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-bd33d9c0-8cd5-4f36-9412-f4b62d9a0cdf tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:40.481769 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-bd33d9c0-8cd5-4f36-9412-f4b62d9a0cdf tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:40.488072 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bd33d9c0-8cd5-4f36-9412-f4b62d9a0cdf tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:40.488797 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bd33d9c0-8cd5-4f36-9412-f4b62d9a0cdf tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:40.489920 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bd33d9c0-8cd5-4f36-9412-f4b62d9a0cdf tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:40.490433 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bd33d9c0-8cd5-4f36-9412-f4b62d9a0cdf tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:40.683530 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-bd33d9c0-8cd5-4f36-9412-f4b62d9a0cdf tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8695df9b3784afc8998af34694b942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d37eeef32a14dfcad683356d32556e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:40.693932 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-bd33d9c0-8cd5-4f36-9412-f4b62d9a0cdf tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84" status: 200 len: 1357 microversion: 2.1 time: 0.219185 Nov 23 09:04:40.694517 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 389/776] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:04:40 2021] GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84 => generated 1357 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:04:41.431106 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f9754611-5d34-4915-a13c-403278440e24 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:41.431872 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-e6cad51d-099e-4e6b-8505-32cbae942037 req-6539abc7-8110-499e-8d75-22ca08e4bb54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33d3a8a8-651e-4b5e-ac3a-2032c9d60800", "name": "network-vif-plugged", "status": "completed", "tag": "9c88cc6d-9402-4eb1-bcaf-c79ca859d7c3"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:04:41.432533 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f9754611-5d34-4915-a13c-403278440e24 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:41.434842 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:04:41.434842 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 09:04:41.444874 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-e6cad51d-099e-4e6b-8505-32cbae942037 req-6539abc7-8110-499e-8d75-22ca08e4bb54 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:41.445800 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-e6cad51d-099e-4e6b-8505-32cbae942037 req-6539abc7-8110-499e-8d75-22ca08e4bb54 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:41.446469 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f9754611-5d34-4915-a13c-403278440e24 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:41.451229 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f9754611-5d34-4915-a13c-403278440e24 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:41.453738 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f9754611-5d34-4915-a13c-403278440e24 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:41.456133 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f9754611-5d34-4915-a13c-403278440e24 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:41.459808 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-e6cad51d-099e-4e6b-8505-32cbae942037 req-6539abc7-8110-499e-8d75-22ca08e4bb54 service nova] Creating event network-vif-plugged:9c88cc6d-9402-4eb1-bcaf-c79ca859d7c3 for instance 33d3a8a8-651e-4b5e-ac3a-2032c9d60800 on hv-cinder-76845 Nov 23 09:04:41.466616 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-e6cad51d-099e-4e6b-8505-32cbae942037 req-6539abc7-8110-499e-8d75-22ca08e4bb54 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109283 Nov 23 09:04:41.468161 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 388/777] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:04:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:04:41.694204 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-f9754611-5d34-4915-a13c-403278440e24 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:41.705577 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-f9754611-5d34-4915-a13c-403278440e24 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:41.707701 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-f9754611-5d34-4915-a13c-403278440e24 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:41.709250 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f9754611-5d34-4915-a13c-403278440e24 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1738 microversion: 2.20 time: 0.282242 Nov 23 09:04:41.709809 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 390/778] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:04:41 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1738 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 09:04:41.714192 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-88cb6d66-80b9-4f85-8c4a-ac2f25eb7902 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:41.715025 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-88cb6d66-80b9-4f85-8c4a-ac2f25eb7902 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:41.725577 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-88cb6d66-80b9-4f85-8c4a-ac2f25eb7902 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:41.726676 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-88cb6d66-80b9-4f85-8c4a-ac2f25eb7902 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:41.727833 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-88cb6d66-80b9-4f85-8c4a-ac2f25eb7902 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:41.728481 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-88cb6d66-80b9-4f85-8c4a-ac2f25eb7902 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:41.883044 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-88cb6d66-80b9-4f85-8c4a-ac2f25eb7902 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8695df9b3784afc8998af34694b942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d37eeef32a14dfcad683356d32556e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:41.892582 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-88cb6d66-80b9-4f85-8c4a-ac2f25eb7902 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84" status: 200 len: 1357 microversion: 2.1 time: 0.183202 Nov 23 09:04:41.893492 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 389/779] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:04:41 2021] GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84 => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:04:42.728577 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-28ca373f-be1c-4290-a58b-c41ed1bd52f7 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:42.729254 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-28ca373f-be1c-4290-a58b-c41ed1bd52f7 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:42.735910 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-28ca373f-be1c-4290-a58b-c41ed1bd52f7 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:42.736358 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-28ca373f-be1c-4290-a58b-c41ed1bd52f7 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:42.737137 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-28ca373f-be1c-4290-a58b-c41ed1bd52f7 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:42.737614 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-28ca373f-be1c-4290-a58b-c41ed1bd52f7 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:42.877832 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-28ca373f-be1c-4290-a58b-c41ed1bd52f7 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:42.887357 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-28ca373f-be1c-4290-a58b-c41ed1bd52f7 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:42.889033 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-28ca373f-be1c-4290-a58b-c41ed1bd52f7 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:42.890368 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-28ca373f-be1c-4290-a58b-c41ed1bd52f7 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1738 microversion: 2.20 time: 0.166460 Nov 23 09:04:42.891030 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 391/780] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:04:42 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:04:42.910097 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-ee22cf51-176c-4ca4-a8dd-503ff08ea3d2 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:42.911232 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-ee22cf51-176c-4ca4-a8dd-503ff08ea3d2 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:42.917791 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ee22cf51-176c-4ca4-a8dd-503ff08ea3d2 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:42.918247 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ee22cf51-176c-4ca4-a8dd-503ff08ea3d2 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:42.919035 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ee22cf51-176c-4ca4-a8dd-503ff08ea3d2 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:42.919470 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ee22cf51-176c-4ca4-a8dd-503ff08ea3d2 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:43.062092 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-ee22cf51-176c-4ca4-a8dd-503ff08ea3d2 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8695df9b3784afc8998af34694b942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d37eeef32a14dfcad683356d32556e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:43.069634 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-ee22cf51-176c-4ca4-a8dd-503ff08ea3d2 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84" status: 200 len: 1357 microversion: 2.1 time: 0.163371 Nov 23 09:04:43.070276 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 390/781] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:04:42 2021] GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:04:43.510011 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-990c0a20-93e4-4521-ae4c-a2dc8b88c871 req-ed7dce10-54b1-44b5-bcb0-b77109b8d19f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b24efc8-4126-486b-92cf-3975dc60bd84", "name": "network-vif-plugged", "status": "completed", "tag": "c2e5dcf0-fb18-4cc4-9002-cb7aa635b9b7"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:04:43.511816 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:04:43.511816 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 09:04:43.518989 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-990c0a20-93e4-4521-ae4c-a2dc8b88c871 req-ed7dce10-54b1-44b5-bcb0-b77109b8d19f service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:43.519522 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-990c0a20-93e4-4521-ae4c-a2dc8b88c871 req-ed7dce10-54b1-44b5-bcb0-b77109b8d19f service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:43.531476 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-990c0a20-93e4-4521-ae4c-a2dc8b88c871 req-ed7dce10-54b1-44b5-bcb0-b77109b8d19f service nova] Creating event network-vif-plugged:c2e5dcf0-fb18-4cc4-9002-cb7aa635b9b7 for instance 0b24efc8-4126-486b-92cf-3975dc60bd84 on hv-cinder-76845 Nov 23 09:04:43.536564 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-990c0a20-93e4-4521-ae4c-a2dc8b88c871 req-ed7dce10-54b1-44b5-bcb0-b77109b8d19f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030988 Nov 23 09:04:43.537264 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 392/782] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:04:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:04:43.909339 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-5ec4d4e7-5595-4af9-b007-09aa87b92f00 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:43.910064 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-5ec4d4e7-5595-4af9-b007-09aa87b92f00 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:43.917768 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5ec4d4e7-5595-4af9-b007-09aa87b92f00 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:43.918371 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5ec4d4e7-5595-4af9-b007-09aa87b92f00 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:43.919107 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5ec4d4e7-5595-4af9-b007-09aa87b92f00 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:43.919755 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5ec4d4e7-5595-4af9-b007-09aa87b92f00 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:44.075916 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-5ec4d4e7-5595-4af9-b007-09aa87b92f00 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:44.087716 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e202bcd2-4281-459d-addb-284d3aac0e57 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:44.089288 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e202bcd2-4281-459d-addb-284d3aac0e57 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:44.099264 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e202bcd2-4281-459d-addb-284d3aac0e57 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:44.100121 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e202bcd2-4281-459d-addb-284d3aac0e57 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:44.100310 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-5ec4d4e7-5595-4af9-b007-09aa87b92f00 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:44.101473 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e202bcd2-4281-459d-addb-284d3aac0e57 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:44.102079 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e202bcd2-4281-459d-addb-284d3aac0e57 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:44.104430 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-5ec4d4e7-5595-4af9-b007-09aa87b92f00 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:44.105765 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-5ec4d4e7-5595-4af9-b007-09aa87b92f00 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1738 microversion: 2.20 time: 0.200209 Nov 23 09:04:44.106721 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 391/783] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:04:43 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1738 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:04:44.270049 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-e202bcd2-4281-459d-addb-284d3aac0e57 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8695df9b3784afc8998af34694b942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d37eeef32a14dfcad683356d32556e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:44.278974 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e202bcd2-4281-459d-addb-284d3aac0e57 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84" status: 200 len: 1357 microversion: 2.1 time: 0.196435 Nov 23 09:04:44.288350 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 393/784] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:04:44 2021] GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84 => generated 1357 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:04:45.124028 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-0b92f9bb-1a16-4af1-a78c-6b8f985dafa3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:45.124751 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-0b92f9bb-1a16-4af1-a78c-6b8f985dafa3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:45.132876 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0b92f9bb-1a16-4af1-a78c-6b8f985dafa3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:45.133474 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0b92f9bb-1a16-4af1-a78c-6b8f985dafa3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:45.134332 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0b92f9bb-1a16-4af1-a78c-6b8f985dafa3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:45.134847 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0b92f9bb-1a16-4af1-a78c-6b8f985dafa3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:45.283728 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-0b92f9bb-1a16-4af1-a78c-6b8f985dafa3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:45.296176 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-26c39330-4e12-4432-942d-169a13b2907b tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:45.297055 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-0b92f9bb-1a16-4af1-a78c-6b8f985dafa3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:45.297625 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-26c39330-4e12-4432-942d-169a13b2907b tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:45.298793 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-0b92f9bb-1a16-4af1-a78c-6b8f985dafa3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:45.300034 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-0b92f9bb-1a16-4af1-a78c-6b8f985dafa3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1738 microversion: 2.20 time: 0.180202 Nov 23 09:04:45.311578 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 392/785] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:04:45 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:04:45.311770 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-26c39330-4e12-4432-942d-169a13b2907b tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:45.311770 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-26c39330-4e12-4432-942d-169a13b2907b tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:45.311770 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-26c39330-4e12-4432-942d-169a13b2907b tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:45.311770 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-26c39330-4e12-4432-942d-169a13b2907b tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:45.455482 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-26c39330-4e12-4432-942d-169a13b2907b tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8695df9b3784afc8998af34694b942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d37eeef32a14dfcad683356d32556e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:45.484397 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-26c39330-4e12-4432-942d-169a13b2907b tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84" status: 200 len: 1547 microversion: 2.1 time: 0.192007 Nov 23 09:04:45.485505 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 394/786] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:04:45 2021] GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84 => generated 1547 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:04:45.502252 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-862eed21-bc15-4408-a77c-127f3c8a1b50 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:45.502884 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-862eed21-bc15-4408-a77c-127f3c8a1b50 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:45.509486 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-862eed21-bc15-4408-a77c-127f3c8a1b50 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:45.509939 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-862eed21-bc15-4408-a77c-127f3c8a1b50 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:45.510751 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-862eed21-bc15-4408-a77c-127f3c8a1b50 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:45.511190 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-862eed21-bc15-4408-a77c-127f3c8a1b50 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:45.677323 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-862eed21-bc15-4408-a77c-127f3c8a1b50 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8695df9b3784afc8998af34694b942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d37eeef32a14dfcad683356d32556e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:45.683576 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-862eed21-bc15-4408-a77c-127f3c8a1b50 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84" status: 200 len: 1547 microversion: 2.1 time: 0.185460 Nov 23 09:04:45.684238 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 393/787] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:04:45 2021] GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84 => generated 1547 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:04:45.703242 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-dec43eaf-33c1-476b-b4e7-1e024b178b2f tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:45.707232 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:04:45.707232 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 09:04:45.714448 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-dec43eaf-33c1-476b-b4e7-1e024b178b2f tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f8695df9b3784afc8998af34694b942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d37eeef32a14dfcad683356d32556e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:45.715625 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-dec43eaf-33c1-476b-b4e7-1e024b178b2f tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Searching by: {'deleted': False, 'project_id': '5d37eeef32a14dfcad683356d32556e8'} {{(pid=116226) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 23 09:04:45.723019 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dec43eaf-33c1-476b-b4e7-1e024b178b2f tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:45.723468 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dec43eaf-33c1-476b-b4e7-1e024b178b2f tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:45.724264 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dec43eaf-33c1-476b-b4e7-1e024b178b2f tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:45.724696 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dec43eaf-33c1-476b-b4e7-1e024b178b2f tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:45.822771 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.multi_cell_list [None req-dec43eaf-33c1-476b-b4e7-1e024b178b2f tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116226) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 23 09:04:45.934797 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-dec43eaf-33c1-476b-b4e7-1e024b178b2f tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.236732 Nov 23 09:04:45.935288 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 395/788] 10.222.0.46 () {58 vars in 1124 bytes} [Tue Nov 23 09:04:45 2021] GET /compute/v2.1/servers => generated 342 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:04:45.948066 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-5a50d386-b2eb-4a4e-b45d-0052e855754f tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:45.948954 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-5a50d386-b2eb-4a4e-b45d-0052e855754f tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:45.955144 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5a50d386-b2eb-4a4e-b45d-0052e855754f tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:45.955598 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5a50d386-b2eb-4a4e-b45d-0052e855754f tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:45.958823 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5a50d386-b2eb-4a4e-b45d-0052e855754f tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:45.959227 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5a50d386-b2eb-4a4e-b45d-0052e855754f tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:46.117715 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-5a50d386-b2eb-4a4e-b45d-0052e855754f tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8695df9b3784afc8998af34694b942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d37eeef32a14dfcad683356d32556e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:46.128262 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-5a50d386-b2eb-4a4e-b45d-0052e855754f tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84" status: 200 len: 1547 microversion: 2.1 time: 0.184739 Nov 23 09:04:46.137468 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 394/789] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:04:45 2021] GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84 => generated 1547 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:04:46.318121 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-0d2a203b-6149-48ab-85ed-db5a045be820 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:46.318728 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-0d2a203b-6149-48ab-85ed-db5a045be820 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:46.325443 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0d2a203b-6149-48ab-85ed-db5a045be820 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:46.325908 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0d2a203b-6149-48ab-85ed-db5a045be820 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:46.326791 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0d2a203b-6149-48ab-85ed-db5a045be820 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:46.327264 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0d2a203b-6149-48ab-85ed-db5a045be820 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:46.539170 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-0d2a203b-6149-48ab-85ed-db5a045be820 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:46.551105 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-0d2a203b-6149-48ab-85ed-db5a045be820 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:46.552779 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-0d2a203b-6149-48ab-85ed-db5a045be820 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:46.555116 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-0d2a203b-6149-48ab-85ed-db5a045be820 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1738 microversion: 2.20 time: 0.240203 Nov 23 09:04:46.555730 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 396/790] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:04:46 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1738 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:04:47.573957 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-d2c57bb0-5095-42a2-ace4-99a12457d8e0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:47.575069 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-d2c57bb0-5095-42a2-ace4-99a12457d8e0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:47.581591 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d2c57bb0-5095-42a2-ace4-99a12457d8e0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:47.582256 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d2c57bb0-5095-42a2-ace4-99a12457d8e0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:47.583310 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d2c57bb0-5095-42a2-ace4-99a12457d8e0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:47.584023 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d2c57bb0-5095-42a2-ace4-99a12457d8e0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:47.753525 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-d2c57bb0-5095-42a2-ace4-99a12457d8e0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:47.762157 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-d2c57bb0-5095-42a2-ace4-99a12457d8e0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:47.763742 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-d2c57bb0-5095-42a2-ace4-99a12457d8e0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:47.764824 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-d2c57bb0-5095-42a2-ace4-99a12457d8e0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1738 microversion: 2.20 time: 0.194457 Nov 23 09:04:47.765883 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 395/791] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:04:47 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:04:47.797106 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b8c2cb4a-0481-42d3-a1c1-3aca700c373e tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "968c3cd2-7658-4a92-92ef-c68773831307"}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:04:47.798417 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b8c2cb4a-0481-42d3-a1c1-3aca700c373e tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:47.805374 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b8c2cb4a-0481-42d3-a1c1-3aca700c373e tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:47.805841 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b8c2cb4a-0481-42d3-a1c1-3aca700c373e tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:47.806625 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b8c2cb4a-0481-42d3-a1c1-3aca700c373e tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:47.807059 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b8c2cb4a-0481-42d3-a1c1-3aca700c373e tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:48.097744 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b8c2cb4a-0481-42d3-a1c1-3aca700c373e tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "POST /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303469 Nov 23 09:04:48.098836 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 397/792] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 23 09:04:47 2021] POST /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:04:48.786315 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-7e2bd87c-a59a-4647-8eb4-c8bb2f29e5c5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:48.792749 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-7e2bd87c-a59a-4647-8eb4-c8bb2f29e5c5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:48.805262 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7e2bd87c-a59a-4647-8eb4-c8bb2f29e5c5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:48.812163 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7e2bd87c-a59a-4647-8eb4-c8bb2f29e5c5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:48.813410 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7e2bd87c-a59a-4647-8eb4-c8bb2f29e5c5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:48.814073 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7e2bd87c-a59a-4647-8eb4-c8bb2f29e5c5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:48.986269 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-7e2bd87c-a59a-4647-8eb4-c8bb2f29e5c5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:48.996422 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-7e2bd87c-a59a-4647-8eb4-c8bb2f29e5c5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:48.998341 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-7e2bd87c-a59a-4647-8eb4-c8bb2f29e5c5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:48.999817 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-7e2bd87c-a59a-4647-8eb4-c8bb2f29e5c5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1738 microversion: 2.20 time: 0.217246 Nov 23 09:04:49.000554 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 396/793] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:04:48 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1738 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:04:50.019627 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-77e66ec3-de30-4944-ae4f-a40bfabefba9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:50.020328 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-77e66ec3-de30-4944-ae4f-a40bfabefba9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:50.026614 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-77e66ec3-de30-4944-ae4f-a40bfabefba9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:50.027073 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-77e66ec3-de30-4944-ae4f-a40bfabefba9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:50.028786 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-77e66ec3-de30-4944-ae4f-a40bfabefba9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:50.029602 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-77e66ec3-de30-4944-ae4f-a40bfabefba9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:50.163334 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-77e66ec3-de30-4944-ae4f-a40bfabefba9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:50.172122 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-77e66ec3-de30-4944-ae4f-a40bfabefba9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:50.173684 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-77e66ec3-de30-4944-ae4f-a40bfabefba9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:50.174837 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-77e66ec3-de30-4944-ae4f-a40bfabefba9 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1720 microversion: 2.20 time: 0.159912 Nov 23 09:04:50.175399 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 398/794] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:04:50 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:04:51.194085 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-f6440fe0-8552-4601-b4d0-a46de50ab29e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:51.194696 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-f6440fe0-8552-4601-b4d0-a46de50ab29e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:51.201041 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f6440fe0-8552-4601-b4d0-a46de50ab29e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:51.201532 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f6440fe0-8552-4601-b4d0-a46de50ab29e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:51.202321 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f6440fe0-8552-4601-b4d0-a46de50ab29e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:51.202766 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f6440fe0-8552-4601-b4d0-a46de50ab29e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:51.333238 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-f6440fe0-8552-4601-b4d0-a46de50ab29e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:51.342062 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-f6440fe0-8552-4601-b4d0-a46de50ab29e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:51.343551 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-f6440fe0-8552-4601-b4d0-a46de50ab29e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:51.344686 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-f6440fe0-8552-4601-b4d0-a46de50ab29e tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1720 microversion: 2.20 time: 0.154366 Nov 23 09:04:51.345260 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 397/795] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:04:51 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:04:51.998498 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-5012d9cc-aad0-4e76-94fd-cdb2afdb541b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:51.998988 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-5012d9cc-aad0-4e76-94fd-cdb2afdb541b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:52.005506 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5012d9cc-aad0-4e76-94fd-cdb2afdb541b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:52.005966 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5012d9cc-aad0-4e76-94fd-cdb2afdb541b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:52.006749 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5012d9cc-aad0-4e76-94fd-cdb2afdb541b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:52.007813 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5012d9cc-aad0-4e76-94fd-cdb2afdb541b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:52.035055 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-5012d9cc-aad0-4e76-94fd-cdb2afdb541b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] Going to try to terminate instance {{(pid=116226) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 09:04:52.118528 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-5012d9cc-aad0-4e76-94fd-cdb2afdb541b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22" status: 204 len: 0 microversion: 2.1 time: 0.123305 Nov 23 09:04:52.119191 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 399/796] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 23 09:04:51 2021] DELETE /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 09:04:52.127336 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-f35eb00a-1706-4720-a285-d4164e4cb58f tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:52.128126 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-f35eb00a-1706-4720-a285-d4164e4cb58f tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:52.134842 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f35eb00a-1706-4720-a285-d4164e4cb58f tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:52.135286 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f35eb00a-1706-4720-a285-d4164e4cb58f tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:52.136137 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f35eb00a-1706-4720-a285-d4164e4cb58f tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:52.136570 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f35eb00a-1706-4720-a285-d4164e4cb58f tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:52.271218 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-f35eb00a-1706-4720-a285-d4164e4cb58f tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:52.279159 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-f35eb00a-1706-4720-a285-d4164e4cb58f tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22" status: 200 len: 1579 microversion: 2.1 time: 0.155548 Nov 23 09:04:52.279730 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 398/797] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:04:52 2021] GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 => generated 1579 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:04:52.363646 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-68bd40b6-1d49-4ea2-bb57-8c90b4cd165f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:52.364337 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-68bd40b6-1d49-4ea2-bb57-8c90b4cd165f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:52.370233 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-68bd40b6-1d49-4ea2-bb57-8c90b4cd165f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:52.370695 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-68bd40b6-1d49-4ea2-bb57-8c90b4cd165f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:52.371478 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-68bd40b6-1d49-4ea2-bb57-8c90b4cd165f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:52.371914 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-68bd40b6-1d49-4ea2-bb57-8c90b4cd165f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:52.507549 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-68bd40b6-1d49-4ea2-bb57-8c90b4cd165f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:52.515408 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-68bd40b6-1d49-4ea2-bb57-8c90b4cd165f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:52.516977 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-68bd40b6-1d49-4ea2-bb57-8c90b4cd165f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:52.518156 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-68bd40b6-1d49-4ea2-bb57-8c90b4cd165f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1723 microversion: 2.20 time: 0.158602 Nov 23 09:04:52.518773 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 400/798] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:04:52 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:04:52.535566 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-c9638258-cc20-4263-b01b-683584ff05e8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0849793-38b1-42be-a68c-69260e4c0262"}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:04:52.536680 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-c9638258-cc20-4263-b01b-683584ff05e8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:52.542539 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c9638258-cc20-4263-b01b-683584ff05e8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:52.542985 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c9638258-cc20-4263-b01b-683584ff05e8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:52.543753 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c9638258-cc20-4263-b01b-683584ff05e8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:52.544184 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c9638258-cc20-4263-b01b-683584ff05e8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:52.797966 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-c9638258-cc20-4263-b01b-683584ff05e8 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.266141 Nov 23 09:04:52.798579 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 399/799] 10.222.0.46 () {62 vars in 1363 bytes} [Tue Nov 23 09:04:52 2021] POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/os-volume_attachments => generated 188 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:04:52.906038 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-ceb45d08-910c-43d2-85d0-3f5c539ed4fa tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:52.906582 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-ceb45d08-910c-43d2-85d0-3f5c539ed4fa tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:52.912722 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ceb45d08-910c-43d2-85d0-3f5c539ed4fa tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:52.913374 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ceb45d08-910c-43d2-85d0-3f5c539ed4fa tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:52.914168 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ceb45d08-910c-43d2-85d0-3f5c539ed4fa tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:52.914606 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ceb45d08-910c-43d2-85d0-3f5c539ed4fa tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:53.149085 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-ceb45d08-910c-43d2-85d0-3f5c539ed4fa tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "DELETE /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/os-volume_attachments/f0849793-38b1-42be-a68c-69260e4c0262" status: 202 len: 0 microversion: 2.20 time: 0.246452 Nov 23 09:04:53.149858 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 401/800] 10.222.0.46 () {60 vars in 1456 bytes} [Tue Nov 23 09:04:52 2021] DELETE /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/os-volume_attachments/f0849793-38b1-42be-a68c-69260e4c0262 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 23 09:04:53.204380 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-cda9b5be-f513-4351-a649-00706712b857 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:04:53.205434 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-cda9b5be-f513-4351-a649-00706712b857 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:53.213460 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-cda9b5be-f513-4351-a649-00706712b857 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:53.213916 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-cda9b5be-f513-4351-a649-00706712b857 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:53.214703 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-cda9b5be-f513-4351-a649-00706712b857 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:53.215143 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-cda9b5be-f513-4351-a649-00706712b857 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:53.216300 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-e01ad485-adab-46c6-85a0-7f3399410929 req-b296c094-f116-4c3b-ada4-2639dbe43d0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33d3a8a8-651e-4b5e-ac3a-2032c9d60800", "name": "network-vif-unplugged", "status": "completed", "tag": "9c88cc6d-9402-4eb1-bcaf-c79ca859d7c3"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:04:53.218142 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:04:53.218142 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 09:04:53.226060 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-e01ad485-adab-46c6-85a0-7f3399410929 req-b296c094-f116-4c3b-ada4-2639dbe43d0c service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:53.226659 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-e01ad485-adab-46c6-85a0-7f3399410929 req-b296c094-f116-4c3b-ada4-2639dbe43d0c service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:53.240082 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.compute.server_external_events [req-e01ad485-adab-46c6-85a0-7f3399410929 req-b296c094-f116-4c3b-ada4-2639dbe43d0c service nova] Unable to find a host for instance 33d3a8a8-651e-4b5e-ac3a-2032c9d60800. Dropping event network-vif-unplugged {{(pid=116226) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 23 09:04:53.241071 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-e01ad485-adab-46c6-85a0-7f3399410929 req-b296c094-f116-4c3b-ada4-2639dbe43d0c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031194 Nov 23 09:04:53.242475 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 402/801] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:04:53 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Nov 23 09:04:53.296692 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-16de33c3-e704-4a3a-b8f1-2e91f3a3db34 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:53.297350 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-16de33c3-e704-4a3a-b8f1-2e91f3a3db34 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:53.304058 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-16de33c3-e704-4a3a-b8f1-2e91f3a3db34 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:53.304587 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-16de33c3-e704-4a3a-b8f1-2e91f3a3db34 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:53.305464 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-16de33c3-e704-4a3a-b8f1-2e91f3a3db34 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:53.305910 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-16de33c3-e704-4a3a-b8f1-2e91f3a3db34 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:53.368236 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-cda9b5be-f513-4351-a649-00706712b857 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action" status: 202 len: 0 microversion: 2.20 time: 0.168008 Nov 23 09:04:53.371062 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 400/802] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 23 09:04:53 2021] POST /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 23 09:04:53.382173 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-11c38122-ccd4-424b-8fa8-ec0fe00dfff3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:53.382903 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-11c38122-ccd4-424b-8fa8-ec0fe00dfff3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:53.392096 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-11c38122-ccd4-424b-8fa8-ec0fe00dfff3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:53.392945 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-11c38122-ccd4-424b-8fa8-ec0fe00dfff3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:53.394119 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-11c38122-ccd4-424b-8fa8-ec0fe00dfff3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:53.394708 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-11c38122-ccd4-424b-8fa8-ec0fe00dfff3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:53.479778 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-16de33c3-e704-4a3a-b8f1-2e91f3a3db34 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:53.488277 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-16de33c3-e704-4a3a-b8f1-2e91f3a3db34 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22" status: 200 len: 1579 microversion: 2.1 time: 0.195156 Nov 23 09:04:53.489287 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 403/803] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:04:53 2021] GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 => generated 1579 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:04:53.552970 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-11c38122-ccd4-424b-8fa8-ec0fe00dfff3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:53.561851 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-11c38122-ccd4-424b-8fa8-ec0fe00dfff3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:53.563388 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-11c38122-ccd4-424b-8fa8-ec0fe00dfff3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:53.564543 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-11c38122-ccd4-424b-8fa8-ec0fe00dfff3 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1671 microversion: 2.20 time: 0.190304 Nov 23 09:04:53.565104 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 401/804] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:04:53 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1671 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:04:54.507807 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-5170da52-bf4a-4fba-80d8-31edbb25e715 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:54.508558 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-5170da52-bf4a-4fba-80d8-31edbb25e715 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:54.519592 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5170da52-bf4a-4fba-80d8-31edbb25e715 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:54.520994 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5170da52-bf4a-4fba-80d8-31edbb25e715 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:54.522064 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5170da52-bf4a-4fba-80d8-31edbb25e715 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:54.522768 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5170da52-bf4a-4fba-80d8-31edbb25e715 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:54.594158 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-cf5a2608-5e86-4fb3-aed3-a236001cc787 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:54.594749 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-cf5a2608-5e86-4fb3-aed3-a236001cc787 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:54.609636 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-cf5a2608-5e86-4fb3-aed3-a236001cc787 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:54.610352 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-cf5a2608-5e86-4fb3-aed3-a236001cc787 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:54.612152 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-cf5a2608-5e86-4fb3-aed3-a236001cc787 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:54.612769 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-cf5a2608-5e86-4fb3-aed3-a236001cc787 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:54.647129 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-5170da52-bf4a-4fba-80d8-31edbb25e715 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:54.655885 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-5170da52-bf4a-4fba-80d8-31edbb25e715 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22" status: 200 len: 1512 microversion: 2.1 time: 0.153358 Nov 23 09:04:54.656836 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 404/805] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:04:54 2021] GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:04:54.661189 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-2aeb6996-e60b-4712-a658-bcc13a2afdc1 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:54.661826 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-2aeb6996-e60b-4712-a658-bcc13a2afdc1 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:54.668943 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2aeb6996-e60b-4712-a658-bcc13a2afdc1 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:54.669474 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2aeb6996-e60b-4712-a658-bcc13a2afdc1 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:54.670363 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2aeb6996-e60b-4712-a658-bcc13a2afdc1 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:54.670810 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2aeb6996-e60b-4712-a658-bcc13a2afdc1 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:54.843068 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-cf5a2608-5e86-4fb3-aed3-a236001cc787 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:54.852359 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-cf5a2608-5e86-4fb3-aed3-a236001cc787 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:54.854394 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-cf5a2608-5e86-4fb3-aed3-a236001cc787 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:54.855656 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-cf5a2608-5e86-4fb3-aed3-a236001cc787 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1729 microversion: 2.20 time: 0.275669 Nov 23 09:04:54.856919 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 402/806] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:04:54 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1729 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 09:04:54.880463 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-2aeb6996-e60b-4712-a658-bcc13a2afdc1 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8695df9b3784afc8998af34694b942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d37eeef32a14dfcad683356d32556e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:54.914766 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-7678f823-2470-41c6-9db5-af4062d29269 req-4521bd85-a900-44d4-8f44-ea463559106b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fcc9f31-a3b6-4476-9c2f-6b22faa98e22", "name": "network-vif-deleted", "tag": "51572632-a474-4f0a-8d0a-5d7f7a5f7e61"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:04:54.916482 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:04:54.916482 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 09:04:54.923575 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-2aeb6996-e60b-4712-a658-bcc13a2afdc1 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84" status: 200 len: 1593 microversion: 2.1 time: 0.265574 Nov 23 09:04:54.923925 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-7678f823-2470-41c6-9db5-af4062d29269 req-4521bd85-a900-44d4-8f44-ea463559106b service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:54.924209 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-7678f823-2470-41c6-9db5-af4062d29269 req-4521bd85-a900-44d4-8f44-ea463559106b service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:54.925037 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 405/807] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:04:54 2021] GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84 => generated 1593 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:04:54.945379 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-7678f823-2470-41c6-9db5-af4062d29269 req-4521bd85-a900-44d4-8f44-ea463559106b service nova] Creating event network-vif-deleted:51572632-a474-4f0a-8d0a-5d7f7a5f7e61 for instance 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 on hv-cinder-76845 Nov 23 09:04:54.954138 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-7678f823-2470-41c6-9db5-af4062d29269 req-4521bd85-a900-44d4-8f44-ea463559106b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041756 Nov 23 09:04:54.955872 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 403/808] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:04:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 09:04:55.675866 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-fce0eed8-97f6-4e04-82a6-a71f585f0ec2 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:55.676424 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-fce0eed8-97f6-4e04-82a6-a71f585f0ec2 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:55.683057 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fce0eed8-97f6-4e04-82a6-a71f585f0ec2 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:55.683513 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fce0eed8-97f6-4e04-82a6-a71f585f0ec2 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:55.690340 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fce0eed8-97f6-4e04-82a6-a71f585f0ec2 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:55.691070 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fce0eed8-97f6-4e04-82a6-a71f585f0ec2 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:55.774827 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fce0eed8-97f6-4e04-82a6-a71f585f0ec2 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:55.776077 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fce0eed8-97f6-4e04-82a6-a71f585f0ec2 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:55.777922 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.objects.instance [None req-fce0eed8-97f6-4e04-82a6-a71f585f0ec2 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lazy-loading 'fault' on Instance uuid 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 {{(pid=116226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 09:04:55.831524 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-fce0eed8-97f6-4e04-82a6-a71f585f0ec2 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:55.855693 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-fce0eed8-97f6-4e04-82a6-a71f585f0ec2 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22" status: 200 len: 1231 microversion: 2.1 time: 0.184484 Nov 23 09:04:55.857198 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 406/809] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:04:55 2021] GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 => generated 1231 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:04:55.879765 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-0a202469-a2b4-4e6a-8ff3-ed2667e262fc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:55.881487 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-0a202469-a2b4-4e6a-8ff3-ed2667e262fc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:55.892911 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0a202469-a2b4-4e6a-8ff3-ed2667e262fc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:55.893646 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0a202469-a2b4-4e6a-8ff3-ed2667e262fc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:55.894612 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0a202469-a2b4-4e6a-8ff3-ed2667e262fc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:55.895213 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0a202469-a2b4-4e6a-8ff3-ed2667e262fc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:56.212094 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-0a202469-a2b4-4e6a-8ff3-ed2667e262fc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:56.223523 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-0a202469-a2b4-4e6a-8ff3-ed2667e262fc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:56.225395 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-0a202469-a2b4-4e6a-8ff3-ed2667e262fc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:56.227678 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-0a202469-a2b4-4e6a-8ff3-ed2667e262fc tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1729 microversion: 2.20 time: 0.354937 Nov 23 09:04:56.228780 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 404/810] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:04:55 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1729 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:04:56.878613 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-36ff0872-8470-4959-a597-b9798799cc7d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:56.880311 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-36ff0872-8470-4959-a597-b9798799cc7d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:56.887532 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-36ff0872-8470-4959-a597-b9798799cc7d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:56.888098 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-36ff0872-8470-4959-a597-b9798799cc7d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:56.890172 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-36ff0872-8470-4959-a597-b9798799cc7d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:56.890758 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-36ff0872-8470-4959-a597-b9798799cc7d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:56.964552 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-36ff0872-8470-4959-a597-b9798799cc7d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:56.965037 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-36ff0872-8470-4959-a597-b9798799cc7d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:56.965523 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.objects.instance [None req-36ff0872-8470-4959-a597-b9798799cc7d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lazy-loading 'fault' on Instance uuid 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 {{(pid=116226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 09:04:57.022111 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-36ff0872-8470-4959-a597-b9798799cc7d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:57.030071 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-36ff0872-8470-4959-a597-b9798799cc7d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22" status: 200 len: 1231 microversion: 2.1 time: 0.155892 Nov 23 09:04:57.030642 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 407/811] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:04:56 2021] GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 => generated 1231 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:04:57.136190 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-0eab1984-879f-4540-ae8b-0c0f7766efb7 req-89857c74-239a-4da3-96e2-fdcac8a14da2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b24efc8-4126-486b-92cf-3975dc60bd84", "tag": "c2e5dcf0-fb18-4cc4-9002-cb7aa635b9b7"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:04:57.137778 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:04:57.137778 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 09:04:57.146429 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-0eab1984-879f-4540-ae8b-0c0f7766efb7 req-89857c74-239a-4da3-96e2-fdcac8a14da2 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:57.147231 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-0eab1984-879f-4540-ae8b-0c0f7766efb7 req-89857c74-239a-4da3-96e2-fdcac8a14da2 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:57.161643 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-0eab1984-879f-4540-ae8b-0c0f7766efb7 req-89857c74-239a-4da3-96e2-fdcac8a14da2 service nova] Creating event network-changed:c2e5dcf0-fb18-4cc4-9002-cb7aa635b9b7 for instance 0b24efc8-4126-486b-92cf-3975dc60bd84 on hv-cinder-76845 Nov 23 09:04:57.169040 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-0eab1984-879f-4540-ae8b-0c0f7766efb7 req-89857c74-239a-4da3-96e2-fdcac8a14da2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036995 Nov 23 09:04:57.170026 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 405/812] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:04:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:04:57.249367 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-799ea2f5-52f0-4e9f-85d2-64eb1cf819f0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:57.250400 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-799ea2f5-52f0-4e9f-85d2-64eb1cf819f0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:57.268812 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-799ea2f5-52f0-4e9f-85d2-64eb1cf819f0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:57.275965 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-799ea2f5-52f0-4e9f-85d2-64eb1cf819f0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:57.277138 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-799ea2f5-52f0-4e9f-85d2-64eb1cf819f0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:57.277811 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-799ea2f5-52f0-4e9f-85d2-64eb1cf819f0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:57.520105 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-799ea2f5-52f0-4e9f-85d2-64eb1cf819f0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:57.555213 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-799ea2f5-52f0-4e9f-85d2-64eb1cf819f0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:57.556794 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-799ea2f5-52f0-4e9f-85d2-64eb1cf819f0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:57.560394 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-799ea2f5-52f0-4e9f-85d2-64eb1cf819f0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1729 microversion: 2.20 time: 0.315482 Nov 23 09:04:57.562680 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 408/813] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:04:57 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1729 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:04:58.055799 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-34fa956a-8e7d-4e3b-9599-092725b6b5ef tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:58.057172 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-34fa956a-8e7d-4e3b-9599-092725b6b5ef tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:58.067275 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-34fa956a-8e7d-4e3b-9599-092725b6b5ef tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:58.067767 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-34fa956a-8e7d-4e3b-9599-092725b6b5ef tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:58.068867 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-34fa956a-8e7d-4e3b-9599-092725b6b5ef tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:58.069454 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-34fa956a-8e7d-4e3b-9599-092725b6b5ef tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:58.113469 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-34fa956a-8e7d-4e3b-9599-092725b6b5ef tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:58.114040 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-34fa956a-8e7d-4e3b-9599-092725b6b5ef tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:58.114503 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.objects.instance [None req-34fa956a-8e7d-4e3b-9599-092725b6b5ef tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lazy-loading 'fault' on Instance uuid 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 {{(pid=116227) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 09:04:58.179512 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-34fa956a-8e7d-4e3b-9599-092725b6b5ef tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:58.187190 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-34fa956a-8e7d-4e3b-9599-092725b6b5ef tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22" status: 200 len: 1231 microversion: 2.1 time: 0.142503 Nov 23 09:04:58.188055 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 406/814] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:04:58 2021] GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 => generated 1231 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:04:58.423891 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-368406ec-b88e-4d10-9b54-cb254db56ea3 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1724034427"}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:04:58.424585 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-368406ec-b88e-4d10-9b54-cb254db56ea3 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:58.432140 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-368406ec-b88e-4d10-9b54-cb254db56ea3 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:58.432928 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-368406ec-b88e-4d10-9b54-cb254db56ea3 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:58.434090 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-368406ec-b88e-4d10-9b54-cb254db56ea3 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:58.434617 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-368406ec-b88e-4d10-9b54-cb254db56ea3 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:58.575370 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.network.security_group_api [None req-368406ec-b88e-4d10-9b54-cb254db56ea3 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Adding security group 6101f722-11cd-4dbd-86cc-954bf7e2d4d0 to port c2e5dcf0-fb18-4cc4-9002-cb7aa635b9b7 Nov 23 09:04:58.579758 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-61aacd13-fd93-4603-adec-d9c0d3535644 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:58.580595 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-61aacd13-fd93-4603-adec-d9c0d3535644 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:58.588949 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-61aacd13-fd93-4603-adec-d9c0d3535644 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:58.589833 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-61aacd13-fd93-4603-adec-d9c0d3535644 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:58.591636 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-61aacd13-fd93-4603-adec-d9c0d3535644 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:58.592918 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-61aacd13-fd93-4603-adec-d9c0d3535644 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:58.770572 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-61aacd13-fd93-4603-adec-d9c0d3535644 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:58.779688 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-61aacd13-fd93-4603-adec-d9c0d3535644 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:58.781195 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-61aacd13-fd93-4603-adec-d9c0d3535644 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:58.788694 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-61aacd13-fd93-4603-adec-d9c0d3535644 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1729 microversion: 2.20 time: 0.212575 Nov 23 09:04:58.789330 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 407/815] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:04:58 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1729 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:04:59.021006 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-368406ec-b88e-4d10-9b54-cb254db56ea3 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "POST /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84/action" status: 202 len: 0 microversion: 2.1 time: 0.600402 Nov 23 09:04:59.026526 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 409/816] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:04:58 2021] POST /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84/action => generated 0 bytes in 606 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:04:59.039669 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d45cdad5-760a-48c1-9e2a-1c05fbad9744 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:59.043328 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d45cdad5-760a-48c1-9e2a-1c05fbad9744 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:59.054744 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d45cdad5-760a-48c1-9e2a-1c05fbad9744 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:59.055666 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d45cdad5-760a-48c1-9e2a-1c05fbad9744 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:59.056749 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d45cdad5-760a-48c1-9e2a-1c05fbad9744 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:59.061844 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d45cdad5-760a-48c1-9e2a-1c05fbad9744 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:59.153024 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-aaffe440-1c76-4bd3-8e4c-99bd1ae471c7 req-524628c7-ada4-441f-aa2c-a11ce217269c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b24efc8-4126-486b-92cf-3975dc60bd84", "tag": "c2e5dcf0-fb18-4cc4-9002-cb7aa635b9b7"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:04:59.155685 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:04:59.155685 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 09:04:59.171024 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-aaffe440-1c76-4bd3-8e4c-99bd1ae471c7 req-524628c7-ada4-441f-aa2c-a11ce217269c service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:59.171814 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-aaffe440-1c76-4bd3-8e4c-99bd1ae471c7 req-524628c7-ada4-441f-aa2c-a11ce217269c service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:59.195914 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-aaffe440-1c76-4bd3-8e4c-99bd1ae471c7 req-524628c7-ada4-441f-aa2c-a11ce217269c service nova] Creating event network-changed:c2e5dcf0-fb18-4cc4-9002-cb7aa635b9b7 for instance 0b24efc8-4126-486b-92cf-3975dc60bd84 on hv-cinder-76845 Nov 23 09:04:59.211886 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-aaffe440-1c76-4bd3-8e4c-99bd1ae471c7 req-524628c7-ada4-441f-aa2c-a11ce217269c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186572 Nov 23 09:04:59.212895 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 408/817] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:04:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 09:04:59.217918 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-73b0a795-e4ab-43a9-ac5f-a701a23e4f82 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:59.218615 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-73b0a795-e4ab-43a9-ac5f-a701a23e4f82 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:59.227645 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-73b0a795-e4ab-43a9-ac5f-a701a23e4f82 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:59.228101 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-73b0a795-e4ab-43a9-ac5f-a701a23e4f82 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:59.228904 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-73b0a795-e4ab-43a9-ac5f-a701a23e4f82 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:59.229380 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-73b0a795-e4ab-43a9-ac5f-a701a23e4f82 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:59.274391 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-73b0a795-e4ab-43a9-ac5f-a701a23e4f82 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:59.275118 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-73b0a795-e4ab-43a9-ac5f-a701a23e4f82 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:59.275895 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.objects.instance [None req-73b0a795-e4ab-43a9-ac5f-a701a23e4f82 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lazy-loading 'fault' on Instance uuid 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 {{(pid=116227) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 09:04:59.331214 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-73b0a795-e4ab-43a9-ac5f-a701a23e4f82 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:59.340731 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-73b0a795-e4ab-43a9-ac5f-a701a23e4f82 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22" status: 200 len: 1231 microversion: 2.1 time: 0.126559 Nov 23 09:04:59.340908 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d45cdad5-760a-48c1-9e2a-1c05fbad9744 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8695df9b3784afc8998af34694b942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d37eeef32a14dfcad683356d32556e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:59.342518 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 409/818] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:04:59 2021] GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 => generated 1231 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:04:59.359761 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d45cdad5-760a-48c1-9e2a-1c05fbad9744 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84" status: 200 len: 1640 microversion: 2.1 time: 0.330341 Nov 23 09:04:59.377346 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 410/819] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:04:59 2021] GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84 => generated 1640 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:04:59.812745 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-45f61663-774d-4ea2-96c6-8f0de281bd8d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:04:59.813345 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-45f61663-774d-4ea2-96c6-8f0de281bd8d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:04:59.819644 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-45f61663-774d-4ea2-96c6-8f0de281bd8d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:59.820281 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-45f61663-774d-4ea2-96c6-8f0de281bd8d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:59.821082 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-45f61663-774d-4ea2-96c6-8f0de281bd8d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:04:59.821554 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-45f61663-774d-4ea2-96c6-8f0de281bd8d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:04:59.957515 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-45f61663-774d-4ea2-96c6-8f0de281bd8d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:59.965989 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-45f61663-774d-4ea2-96c6-8f0de281bd8d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:59.967489 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-45f61663-774d-4ea2-96c6-8f0de281bd8d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:04:59.968636 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-45f61663-774d-4ea2-96c6-8f0de281bd8d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1729 microversion: 2.20 time: 0.164816 Nov 23 09:04:59.969222 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 410/820] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:04:59 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:05:00.359658 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a81add92-fc1a-48f2-9247-0da7740eb1d7 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:00.360249 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a81add92-fc1a-48f2-9247-0da7740eb1d7 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:00.366921 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a81add92-fc1a-48f2-9247-0da7740eb1d7 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:00.367393 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a81add92-fc1a-48f2-9247-0da7740eb1d7 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:00.368178 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a81add92-fc1a-48f2-9247-0da7740eb1d7 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:00.368623 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a81add92-fc1a-48f2-9247-0da7740eb1d7 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:00.401658 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a81add92-fc1a-48f2-9247-0da7740eb1d7 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:00.402206 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a81add92-fc1a-48f2-9247-0da7740eb1d7 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:00.402743 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.objects.instance [None req-a81add92-fc1a-48f2-9247-0da7740eb1d7 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lazy-loading 'fault' on Instance uuid 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 {{(pid=116226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 09:05:00.443370 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a81add92-fc1a-48f2-9247-0da7740eb1d7 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:00.451607 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a81add92-fc1a-48f2-9247-0da7740eb1d7 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22" status: 200 len: 1231 microversion: 2.1 time: 0.095644 Nov 23 09:05:00.452199 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 411/821] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:05:00 2021] GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 => generated 1231 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:05:00.987689 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-938ee687-7e4e-474f-8cf3-23e8787cc151 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:00.988346 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-938ee687-7e4e-474f-8cf3-23e8787cc151 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:00.995622 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-938ee687-7e4e-474f-8cf3-23e8787cc151 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:00.996162 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-938ee687-7e4e-474f-8cf3-23e8787cc151 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:00.997025 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-938ee687-7e4e-474f-8cf3-23e8787cc151 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:00.997560 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-938ee687-7e4e-474f-8cf3-23e8787cc151 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:01.133997 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-938ee687-7e4e-474f-8cf3-23e8787cc151 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:01.141883 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-938ee687-7e4e-474f-8cf3-23e8787cc151 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:01.143382 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-938ee687-7e4e-474f-8cf3-23e8787cc151 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:01.144540 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-938ee687-7e4e-474f-8cf3-23e8787cc151 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1729 microversion: 2.20 time: 0.160723 Nov 23 09:05:01.145308 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 411/822] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:05:00 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:05:01.469834 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-dd72f83f-a7c9-482e-b9ca-37356a723498 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:01.471235 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-dd72f83f-a7c9-482e-b9ca-37356a723498 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:01.479165 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dd72f83f-a7c9-482e-b9ca-37356a723498 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:01.479621 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dd72f83f-a7c9-482e-b9ca-37356a723498 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:01.480587 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dd72f83f-a7c9-482e-b9ca-37356a723498 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:01.481108 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dd72f83f-a7c9-482e-b9ca-37356a723498 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:01.512101 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dd72f83f-a7c9-482e-b9ca-37356a723498 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:01.512549 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dd72f83f-a7c9-482e-b9ca-37356a723498 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:01.513000 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.objects.instance [None req-dd72f83f-a7c9-482e-b9ca-37356a723498 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lazy-loading 'fault' on Instance uuid 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 {{(pid=116226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 09:05:01.553227 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-dd72f83f-a7c9-482e-b9ca-37356a723498 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:01.560725 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-dd72f83f-a7c9-482e-b9ca-37356a723498 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22" status: 200 len: 1231 microversion: 2.1 time: 0.094961 Nov 23 09:05:01.561318 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 412/823] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:05:01 2021] GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 => generated 1231 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:05:02.163151 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-2715aa3e-613d-404f-9c08-3ffefa468d61 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:02.163830 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-2715aa3e-613d-404f-9c08-3ffefa468d61 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:02.170043 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2715aa3e-613d-404f-9c08-3ffefa468d61 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:02.170496 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2715aa3e-613d-404f-9c08-3ffefa468d61 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:02.171282 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2715aa3e-613d-404f-9c08-3ffefa468d61 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:02.171713 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2715aa3e-613d-404f-9c08-3ffefa468d61 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:02.309653 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-2715aa3e-613d-404f-9c08-3ffefa468d61 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:02.317496 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-2715aa3e-613d-404f-9c08-3ffefa468d61 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:02.319645 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-2715aa3e-613d-404f-9c08-3ffefa468d61 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:02.320934 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-2715aa3e-613d-404f-9c08-3ffefa468d61 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1729 microversion: 2.20 time: 0.161525 Nov 23 09:05:02.321539 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 412/824] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:05:02 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 09:05:02.579228 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d674f6cd-b0c4-4048-ba84-a8e62aa67287 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:02.579919 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d674f6cd-b0c4-4048-ba84-a8e62aa67287 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:02.586596 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d674f6cd-b0c4-4048-ba84-a8e62aa67287 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:02.587048 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d674f6cd-b0c4-4048-ba84-a8e62aa67287 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:02.587836 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d674f6cd-b0c4-4048-ba84-a8e62aa67287 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:02.588274 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d674f6cd-b0c4-4048-ba84-a8e62aa67287 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:02.622782 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d674f6cd-b0c4-4048-ba84-a8e62aa67287 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:02.623285 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d674f6cd-b0c4-4048-ba84-a8e62aa67287 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:02.623738 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.objects.instance [None req-d674f6cd-b0c4-4048-ba84-a8e62aa67287 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lazy-loading 'fault' on Instance uuid 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 {{(pid=116226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 09:05:02.672299 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d674f6cd-b0c4-4048-ba84-a8e62aa67287 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:02.681025 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d674f6cd-b0c4-4048-ba84-a8e62aa67287 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22" status: 200 len: 1231 microversion: 2.1 time: 0.105474 Nov 23 09:05:02.681638 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 413/825] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:05:02 2021] GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 => generated 1231 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:05:03.340551 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-20d6c896-e9ca-42c6-8dca-f4c20a68b8ff tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:03.341193 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-20d6c896-e9ca-42c6-8dca-f4c20a68b8ff tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:03.347438 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-20d6c896-e9ca-42c6-8dca-f4c20a68b8ff tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:03.347932 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-20d6c896-e9ca-42c6-8dca-f4c20a68b8ff tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:03.348654 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-20d6c896-e9ca-42c6-8dca-f4c20a68b8ff tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:03.349089 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-20d6c896-e9ca-42c6-8dca-f4c20a68b8ff tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:03.484882 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-20d6c896-e9ca-42c6-8dca-f4c20a68b8ff tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:03.494210 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-20d6c896-e9ca-42c6-8dca-f4c20a68b8ff tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:03.495711 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-20d6c896-e9ca-42c6-8dca-f4c20a68b8ff tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:03.496908 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-20d6c896-e9ca-42c6-8dca-f4c20a68b8ff tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1729 microversion: 2.20 time: 0.160086 Nov 23 09:05:03.497505 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 413/826] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:05:03 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 09:05:03.698008 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-ca6651f9-1c42-43d7-9298-64bc5ddf6676 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:03.698583 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-ca6651f9-1c42-43d7-9298-64bc5ddf6676 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:03.704899 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ca6651f9-1c42-43d7-9298-64bc5ddf6676 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:03.705394 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ca6651f9-1c42-43d7-9298-64bc5ddf6676 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:03.706180 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ca6651f9-1c42-43d7-9298-64bc5ddf6676 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:03.706620 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ca6651f9-1c42-43d7-9298-64bc5ddf6676 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:03.738388 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ca6651f9-1c42-43d7-9298-64bc5ddf6676 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:03.738841 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ca6651f9-1c42-43d7-9298-64bc5ddf6676 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:03.739297 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.objects.instance [None req-ca6651f9-1c42-43d7-9298-64bc5ddf6676 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lazy-loading 'fault' on Instance uuid 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 {{(pid=116226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 09:05:03.779879 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-ca6651f9-1c42-43d7-9298-64bc5ddf6676 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:03.787167 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-ca6651f9-1c42-43d7-9298-64bc5ddf6676 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22" status: 200 len: 1231 microversion: 2.1 time: 0.093058 Nov 23 09:05:03.788448 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 414/827] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:05:03 2021] GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 => generated 1231 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:05:04.516511 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-45327571-6707-4eeb-9b26-181899224c9a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:04.518923 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-45327571-6707-4eeb-9b26-181899224c9a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:04.523579 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-45327571-6707-4eeb-9b26-181899224c9a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:04.524132 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-45327571-6707-4eeb-9b26-181899224c9a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:04.525016 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-45327571-6707-4eeb-9b26-181899224c9a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:04.525572 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-45327571-6707-4eeb-9b26-181899224c9a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:04.668666 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-45327571-6707-4eeb-9b26-181899224c9a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:04.676842 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-45327571-6707-4eeb-9b26-181899224c9a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:04.679178 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-45327571-6707-4eeb-9b26-181899224c9a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:04.680380 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-45327571-6707-4eeb-9b26-181899224c9a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1729 microversion: 2.20 time: 0.168801 Nov 23 09:05:04.680946 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 414/828] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:05:04 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:05:04.804338 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-562eaa56-6dcd-4549-9d63-702759bee542 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:04.805103 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-562eaa56-6dcd-4549-9d63-702759bee542 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:04.811114 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-562eaa56-6dcd-4549-9d63-702759bee542 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:04.811567 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-562eaa56-6dcd-4549-9d63-702759bee542 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:04.812343 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-562eaa56-6dcd-4549-9d63-702759bee542 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:04.812777 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-562eaa56-6dcd-4549-9d63-702759bee542 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:04.844227 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-562eaa56-6dcd-4549-9d63-702759bee542 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:04.844675 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-562eaa56-6dcd-4549-9d63-702759bee542 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:04.845126 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.objects.instance [None req-562eaa56-6dcd-4549-9d63-702759bee542 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lazy-loading 'fault' on Instance uuid 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 {{(pid=116226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 09:05:04.890518 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-562eaa56-6dcd-4549-9d63-702759bee542 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:04.898844 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-562eaa56-6dcd-4549-9d63-702759bee542 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22" status: 200 len: 1231 microversion: 2.1 time: 0.098852 Nov 23 09:05:04.899555 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 415/829] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:05:04 2021] GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 => generated 1231 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:05:05.698728 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-4cbf120f-f0f5-46a3-9630-b3c817b70c5d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:05.699347 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-4cbf120f-f0f5-46a3-9630-b3c817b70c5d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:05.705684 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4cbf120f-f0f5-46a3-9630-b3c817b70c5d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:05.706134 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4cbf120f-f0f5-46a3-9630-b3c817b70c5d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:05.706921 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4cbf120f-f0f5-46a3-9630-b3c817b70c5d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:05.707387 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4cbf120f-f0f5-46a3-9630-b3c817b70c5d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:05.845614 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-4cbf120f-f0f5-46a3-9630-b3c817b70c5d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:05.854930 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-4cbf120f-f0f5-46a3-9630-b3c817b70c5d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:05.856284 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-4cbf120f-f0f5-46a3-9630-b3c817b70c5d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:05.857450 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-4cbf120f-f0f5-46a3-9630-b3c817b70c5d tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1729 microversion: 2.20 time: 0.162374 Nov 23 09:05:05.858020 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 415/830] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:05:05 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:05:05.916351 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-24556b02-8458-4367-8e26-2cc791a3da92 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:05.916998 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-24556b02-8458-4367-8e26-2cc791a3da92 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:05.927759 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-24556b02-8458-4367-8e26-2cc791a3da92 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:05.928801 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-24556b02-8458-4367-8e26-2cc791a3da92 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:05.929758 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-24556b02-8458-4367-8e26-2cc791a3da92 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:05.930160 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-24556b02-8458-4367-8e26-2cc791a3da92 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:05.963086 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-24556b02-8458-4367-8e26-2cc791a3da92 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:05.963457 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-24556b02-8458-4367-8e26-2cc791a3da92 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:05.963906 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.objects.instance [None req-24556b02-8458-4367-8e26-2cc791a3da92 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lazy-loading 'fault' on Instance uuid 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 {{(pid=116226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 09:05:06.001278 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-24556b02-8458-4367-8e26-2cc791a3da92 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:06.009421 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-24556b02-8458-4367-8e26-2cc791a3da92 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22" status: 200 len: 1231 microversion: 2.1 time: 0.097424 Nov 23 09:05:06.010131 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 416/831] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:05:05 2021] GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 => generated 1231 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:05:06.876554 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-4d32479a-67d1-41bd-a737-441e619ffd87 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:06.877257 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-4d32479a-67d1-41bd-a737-441e619ffd87 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:06.884739 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4d32479a-67d1-41bd-a737-441e619ffd87 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:06.885214 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4d32479a-67d1-41bd-a737-441e619ffd87 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:06.885997 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4d32479a-67d1-41bd-a737-441e619ffd87 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:06.886436 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4d32479a-67d1-41bd-a737-441e619ffd87 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:07.028978 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e9e4669f-837f-41ae-b00a-9c0c4edb719c tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:07.029734 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e9e4669f-837f-41ae-b00a-9c0c4edb719c tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:07.029958 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-4d32479a-67d1-41bd-a737-441e619ffd87 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:07.037071 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e9e4669f-837f-41ae-b00a-9c0c4edb719c tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:07.038241 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e9e4669f-837f-41ae-b00a-9c0c4edb719c tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:07.038516 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-4d32479a-67d1-41bd-a737-441e619ffd87 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:07.039357 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e9e4669f-837f-41ae-b00a-9c0c4edb719c tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:07.039882 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e9e4669f-837f-41ae-b00a-9c0c4edb719c tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:07.040024 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-4d32479a-67d1-41bd-a737-441e619ffd87 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:07.041189 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-4d32479a-67d1-41bd-a737-441e619ffd87 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1729 microversion: 2.20 time: 0.168352 Nov 23 09:05:07.041763 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 416/832] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:05:06 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:05:07.070368 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e9e4669f-837f-41ae-b00a-9c0c4edb719c tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:07.070814 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e9e4669f-837f-41ae-b00a-9c0c4edb719c tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:07.071257 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.objects.instance [None req-e9e4669f-837f-41ae-b00a-9c0c4edb719c tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lazy-loading 'fault' on Instance uuid 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 {{(pid=116226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 09:05:07.111950 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-e9e4669f-837f-41ae-b00a-9c0c4edb719c tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:07.120053 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e9e4669f-837f-41ae-b00a-9c0c4edb719c tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22" status: 200 len: 1231 microversion: 2.1 time: 0.097367 Nov 23 09:05:07.120653 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 417/833] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:05:07 2021] GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 => generated 1231 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:05:08.059498 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-b4e834ca-3105-4d75-80eb-777ec6dce998 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:08.060142 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-b4e834ca-3105-4d75-80eb-777ec6dce998 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:08.066387 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b4e834ca-3105-4d75-80eb-777ec6dce998 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:08.066847 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b4e834ca-3105-4d75-80eb-777ec6dce998 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:08.067639 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b4e834ca-3105-4d75-80eb-777ec6dce998 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:08.068081 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b4e834ca-3105-4d75-80eb-777ec6dce998 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:08.137284 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8f8c177e-a16f-4d6b-a377-70984a1d242b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:08.137894 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-8f8c177e-a16f-4d6b-a377-70984a1d242b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:08.143864 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8f8c177e-a16f-4d6b-a377-70984a1d242b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:08.144318 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8f8c177e-a16f-4d6b-a377-70984a1d242b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:08.145156 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8f8c177e-a16f-4d6b-a377-70984a1d242b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:08.145796 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8f8c177e-a16f-4d6b-a377-70984a1d242b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:08.160252 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-8f8c177e-a16f-4d6b-a377-70984a1d242b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] HTTP exception thrown: Instance 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 could not be found. Nov 23 09:05:08.160908 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8f8c177e-a16f-4d6b-a377-70984a1d242b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Returning 404 to user: Instance 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 09:05:08.162045 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-8f8c177e-a16f-4d6b-a377-70984a1d242b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22" status: 404 len: 111 microversion: 2.1 time: 0.028579 Nov 23 09:05:08.162641 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 418/834] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:05:08 2021] GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 23 09:05:08.210116 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-b4e834ca-3105-4d75-80eb-777ec6dce998 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:08.218413 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-b4e834ca-3105-4d75-80eb-777ec6dce998 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:08.220161 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-b4e834ca-3105-4d75-80eb-777ec6dce998 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:08.221623 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-b4e834ca-3105-4d75-80eb-777ec6dce998 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1729 microversion: 2.20 time: 0.165815 Nov 23 09:05:08.222501 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 417/835] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:05:08 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:05:08.260008 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-801e723e-5e94-4620-bf52-67de32a693a6 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1378566928", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1835873804", "security_groups": [{"name": "tempest-secgroup-smoke-474799054"}], "block_device_mapping_v2": [{"uuid": "bd38a92c-8148-42ff-8c5b-bff161548fc6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d2703dbd-849e-45eb-9768-17f699057b49"}]}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:05:08.424474 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.network.neutron [None req-801e723e-5e94-4620-bf52-67de32a693a6 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] validate_networks() for [('d2703dbd-849e-45eb-9768-17f699057b49', None, None, None, None, None)] {{(pid=116226) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 09:05:08.996418 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-801e723e-5e94-4620-bf52-67de32a693a6 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Flavor limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 09:05:08.996968 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-801e723e-5e94-4620-bf52-67de32a693a6 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Image limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 09:05:08.997378 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-801e723e-5e94-4620-bf52-67de32a693a6 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Flavor pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 09:05:08.997796 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-801e723e-5e94-4620-bf52-67de32a693a6 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Image pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 09:05:08.998292 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-801e723e-5e94-4620-bf52-67de32a693a6 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 09:05:09.006969 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-801e723e-5e94-4620-bf52-67de32a693a6 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:09.007479 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-801e723e-5e94-4620-bf52-67de32a693a6 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:09.008305 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-801e723e-5e94-4620-bf52-67de32a693a6 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:09.008742 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-801e723e-5e94-4620-bf52-67de32a693a6 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:09.025772 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-801e723e-5e94-4620-bf52-67de32a693a6 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Getting quotas for project 229671159ee9412ca1bcc93a838c73c1. Resources: {'instances', 'ram', 'cores'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 09:05:09.029767 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-801e723e-5e94-4620-bf52-67de32a693a6 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Getting quotas for user 8e26aa2383ab4e5da1bdc6712f58af06 and project 229671159ee9412ca1bcc93a838c73c1. Resources: {'instances', 'ram', 'cores'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 09:05:09.086083 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-801e723e-5e94-4620-bf52-67de32a693a6 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Going to run 1 instances... {{(pid=116226) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 09:05:09.088234 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-801e723e-5e94-4620-bf52-67de32a693a6 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 1385abf2-5cb6-424f-9768-048d7f9efaac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bd38a92c-8148-42ff-8c5b-bff161548fc6',volume_size=None,volume_type=None)] {{(pid=116226) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 09:05:09.213314 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-801e723e-5e94-4620-bf52-67de32a693a6 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.957462 Nov 23 09:05:09.214284 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 419/836] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 23 09:05:08 2021] POST /compute/v2.1/servers => generated 405 bytes in 959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 09:05:09.223641 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-8bc64452-042c-468b-889b-cc5d1a13e327 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:09.224355 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-8bc64452-042c-468b-889b-cc5d1a13e327 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 1385abf2-5cb6-424f-9768-048d7f9efaac] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:09.239735 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-625c8c92-65b2-4f53-a825-e3e69139d83a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:09.242085 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-625c8c92-65b2-4f53-a825-e3e69139d83a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:09.248636 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-625c8c92-65b2-4f53-a825-e3e69139d83a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:09.249101 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-625c8c92-65b2-4f53-a825-e3e69139d83a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:09.249974 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-625c8c92-65b2-4f53-a825-e3e69139d83a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:09.250421 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-625c8c92-65b2-4f53-a825-e3e69139d83a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:09.277518 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-8bc64452-042c-468b-889b-cc5d1a13e327 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:09.284255 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-8bc64452-042c-468b-889b-cc5d1a13e327 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/1385abf2-5cb6-424f-9768-048d7f9efaac" status: 200 len: 1095 microversion: 2.1 time: 0.064244 Nov 23 09:05:09.284895 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 418/837] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:05:09 2021] GET /compute/v2.1/servers/1385abf2-5cb6-424f-9768-048d7f9efaac => generated 1095 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:05:09.387964 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-625c8c92-65b2-4f53-a825-e3e69139d83a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:09.397220 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-625c8c92-65b2-4f53-a825-e3e69139d83a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:09.399049 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-625c8c92-65b2-4f53-a825-e3e69139d83a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:09.400170 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-625c8c92-65b2-4f53-a825-e3e69139d83a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1729 microversion: 2.20 time: 0.164394 Nov 23 09:05:09.400718 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 420/838] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:05:09 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 09:05:10.300991 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-a598a32f-6932-4709-b4f4-700c1ae02492 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:10.301675 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-a598a32f-6932-4709-b4f4-700c1ae02492 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 1385abf2-5cb6-424f-9768-048d7f9efaac] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:10.309574 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a598a32f-6932-4709-b4f4-700c1ae02492 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:10.310033 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a598a32f-6932-4709-b4f4-700c1ae02492 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:10.310837 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a598a32f-6932-4709-b4f4-700c1ae02492 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:10.311281 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a598a32f-6932-4709-b4f4-700c1ae02492 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:10.372041 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-a598a32f-6932-4709-b4f4-700c1ae02492 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:10.379569 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-a598a32f-6932-4709-b4f4-700c1ae02492 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/1385abf2-5cb6-424f-9768-048d7f9efaac" status: 200 len: 1211 microversion: 2.1 time: 0.082207 Nov 23 09:05:10.380156 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 419/839] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:05:10 2021] GET /compute/v2.1/servers/1385abf2-5cb6-424f-9768-048d7f9efaac => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:05:10.418725 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-bd4ee81d-c851-4db1-ae14-e17b36d0c9db tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:10.419359 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-bd4ee81d-c851-4db1-ae14-e17b36d0c9db tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:10.425780 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bd4ee81d-c851-4db1-ae14-e17b36d0c9db tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:10.426231 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bd4ee81d-c851-4db1-ae14-e17b36d0c9db tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:10.427020 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bd4ee81d-c851-4db1-ae14-e17b36d0c9db tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:10.427454 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bd4ee81d-c851-4db1-ae14-e17b36d0c9db tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:10.661725 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-bd4ee81d-c851-4db1-ae14-e17b36d0c9db tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:10.671485 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-bd4ee81d-c851-4db1-ae14-e17b36d0c9db tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:10.673127 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-bd4ee81d-c851-4db1-ae14-e17b36d0c9db tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:10.674485 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-bd4ee81d-c851-4db1-ae14-e17b36d0c9db tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1729 microversion: 2.20 time: 0.259555 Nov 23 09:05:10.675376 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 421/840] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:05:10 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1729 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:05:11.399189 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-d2d072a9-4b88-4c23-9ed2-7aa86b3a8faa tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:11.400378 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-d2d072a9-4b88-4c23-9ed2-7aa86b3a8faa tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 1385abf2-5cb6-424f-9768-048d7f9efaac] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:11.406877 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d2d072a9-4b88-4c23-9ed2-7aa86b3a8faa tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:11.407607 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d2d072a9-4b88-4c23-9ed2-7aa86b3a8faa tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:11.408648 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d2d072a9-4b88-4c23-9ed2-7aa86b3a8faa tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:11.409321 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d2d072a9-4b88-4c23-9ed2-7aa86b3a8faa tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:11.552235 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-d2d072a9-4b88-4c23-9ed2-7aa86b3a8faa tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:11.560674 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-d2d072a9-4b88-4c23-9ed2-7aa86b3a8faa tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/1385abf2-5cb6-424f-9768-048d7f9efaac" status: 200 len: 1266 microversion: 2.1 time: 0.166456 Nov 23 09:05:11.561487 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 420/841] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:05:11 2021] GET /compute/v2.1/servers/1385abf2-5cb6-424f-9768-048d7f9efaac => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:05:11.694015 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-716631ed-2df3-46b9-9b35-fd184699a381 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:11.695423 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-716631ed-2df3-46b9-9b35-fd184699a381 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:11.701564 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-716631ed-2df3-46b9-9b35-fd184699a381 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:11.702243 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-716631ed-2df3-46b9-9b35-fd184699a381 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:11.703064 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-716631ed-2df3-46b9-9b35-fd184699a381 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:11.703454 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-716631ed-2df3-46b9-9b35-fd184699a381 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:11.770066 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-0745a089-2638-4451-8bbb-96844469f68c req-b5f37d8e-aafc-48fc-8de6-825172e31ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1385abf2-5cb6-424f-9768-048d7f9efaac", "tag": "833fdf90-74a3-408c-a75b-f0c5c196ddcf"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:05:11.772574 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:05:11.772574 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 09:05:11.783615 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-0745a089-2638-4451-8bbb-96844469f68c req-b5f37d8e-aafc-48fc-8de6-825172e31ed2 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:11.784565 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-0745a089-2638-4451-8bbb-96844469f68c req-b5f37d8e-aafc-48fc-8de6-825172e31ed2 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:11.804053 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-0745a089-2638-4451-8bbb-96844469f68c req-b5f37d8e-aafc-48fc-8de6-825172e31ed2 service nova] Creating event network-changed:833fdf90-74a3-408c-a75b-f0c5c196ddcf for instance 1385abf2-5cb6-424f-9768-048d7f9efaac on hv-cinder-76845 Nov 23 09:05:11.811185 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-0745a089-2638-4451-8bbb-96844469f68c req-b5f37d8e-aafc-48fc-8de6-825172e31ed2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044336 Nov 23 09:05:11.812328 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 421/842] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:05:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 09:05:11.989613 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-716631ed-2df3-46b9-9b35-fd184699a381 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:11.997494 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-716631ed-2df3-46b9-9b35-fd184699a381 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:11.999013 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-716631ed-2df3-46b9-9b35-fd184699a381 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:12.000190 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-716631ed-2df3-46b9-9b35-fd184699a381 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1729 microversion: 2.20 time: 0.309829 Nov 23 09:05:12.000762 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 422/843] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:05:11 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1729 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:05:12.578302 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-a68191c8-ca04-47d8-bd00-c8ce63d246b0 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:12.579013 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-a68191c8-ca04-47d8-bd00-c8ce63d246b0 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 1385abf2-5cb6-424f-9768-048d7f9efaac] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:12.586592 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a68191c8-ca04-47d8-bd00-c8ce63d246b0 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:12.587104 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a68191c8-ca04-47d8-bd00-c8ce63d246b0 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:12.587952 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a68191c8-ca04-47d8-bd00-c8ce63d246b0 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:12.588445 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a68191c8-ca04-47d8-bd00-c8ce63d246b0 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:12.721334 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-a68191c8-ca04-47d8-bd00-c8ce63d246b0 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:12.729392 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-a68191c8-ca04-47d8-bd00-c8ce63d246b0 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/1385abf2-5cb6-424f-9768-048d7f9efaac" status: 200 len: 1266 microversion: 2.1 time: 0.155134 Nov 23 09:05:12.729976 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 422/844] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:05:12 2021] GET /compute/v2.1/servers/1385abf2-5cb6-424f-9768-048d7f9efaac => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:05:13.018626 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-9d557f78-c43b-467f-9e7f-c049ede01487 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:13.019155 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-9d557f78-c43b-467f-9e7f-c049ede01487 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:13.025535 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9d557f78-c43b-467f-9e7f-c049ede01487 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:13.025992 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9d557f78-c43b-467f-9e7f-c049ede01487 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:13.026758 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9d557f78-c43b-467f-9e7f-c049ede01487 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:13.027188 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9d557f78-c43b-467f-9e7f-c049ede01487 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:13.155083 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-9d557f78-c43b-467f-9e7f-c049ede01487 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:13.163323 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-9d557f78-c43b-467f-9e7f-c049ede01487 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:13.164845 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-9d557f78-c43b-467f-9e7f-c049ede01487 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:13.166413 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-9d557f78-c43b-467f-9e7f-c049ede01487 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1729 microversion: 2.20 time: 0.151234 Nov 23 09:05:13.167401 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 423/845] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:05:13 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:05:13.323656 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-8a60b6f5-9766-4d2d-9a20-d1edf5990651 req-b0587104-480c-4ce9-b965-3b9c267edaad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33d3a8a8-651e-4b5e-ac3a-2032c9d60800", "name": "network-vif-plugged", "status": "completed", "tag": "9c88cc6d-9402-4eb1-bcaf-c79ca859d7c3"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:05:13.325232 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:05:13.325232 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 09:05:13.332244 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-8a60b6f5-9766-4d2d-9a20-d1edf5990651 req-b0587104-480c-4ce9-b965-3b9c267edaad service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:13.332715 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-8a60b6f5-9766-4d2d-9a20-d1edf5990651 req-b0587104-480c-4ce9-b965-3b9c267edaad service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:13.345456 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-8a60b6f5-9766-4d2d-9a20-d1edf5990651 req-b0587104-480c-4ce9-b965-3b9c267edaad service nova] Creating event network-vif-plugged:9c88cc6d-9402-4eb1-bcaf-c79ca859d7c3 for instance 33d3a8a8-651e-4b5e-ac3a-2032c9d60800 on hv-cinder-76845 Nov 23 09:05:13.350297 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-8a60b6f5-9766-4d2d-9a20-d1edf5990651 req-b0587104-480c-4ce9-b965-3b9c267edaad service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030170 Nov 23 09:05:13.351076 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 423/846] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:05:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:05:13.746799 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-40964e81-be42-4607-9da3-5c56b27c73fa tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:13.747433 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-40964e81-be42-4607-9da3-5c56b27c73fa tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 1385abf2-5cb6-424f-9768-048d7f9efaac] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:13.753330 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-40964e81-be42-4607-9da3-5c56b27c73fa tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:13.753787 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-40964e81-be42-4607-9da3-5c56b27c73fa tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:13.754554 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-40964e81-be42-4607-9da3-5c56b27c73fa tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:13.754988 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-40964e81-be42-4607-9da3-5c56b27c73fa tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:13.882969 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-40964e81-be42-4607-9da3-5c56b27c73fa tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:13.890191 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-40964e81-be42-4607-9da3-5c56b27c73fa tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/1385abf2-5cb6-424f-9768-048d7f9efaac" status: 200 len: 1266 microversion: 2.1 time: 0.147031 Nov 23 09:05:13.890758 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 424/847] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:05:13 2021] GET /compute/v2.1/servers/1385abf2-5cb6-424f-9768-048d7f9efaac => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:05:14.184480 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-93fd0dd4-660a-4503-83cd-470e24c2c1ed tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:14.185096 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-93fd0dd4-660a-4503-83cd-470e24c2c1ed tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:14.191593 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-93fd0dd4-660a-4503-83cd-470e24c2c1ed tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:14.192050 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-93fd0dd4-660a-4503-83cd-470e24c2c1ed tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:14.192828 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-93fd0dd4-660a-4503-83cd-470e24c2c1ed tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:14.193296 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-93fd0dd4-660a-4503-83cd-470e24c2c1ed tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:14.325435 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-93fd0dd4-660a-4503-83cd-470e24c2c1ed tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:14.333016 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-93fd0dd4-660a-4503-83cd-470e24c2c1ed tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:14.335077 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-93fd0dd4-660a-4503-83cd-470e24c2c1ed tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:14.336518 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-93fd0dd4-660a-4503-83cd-470e24c2c1ed tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1729 microversion: 2.20 time: 0.156153 Nov 23 09:05:14.337106 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 424/848] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:05:14 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:05:14.906936 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-07186754-368a-4ae8-923f-69fb6b437e54 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:14.907546 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-07186754-368a-4ae8-923f-69fb6b437e54 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 1385abf2-5cb6-424f-9768-048d7f9efaac] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:14.914289 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-07186754-368a-4ae8-923f-69fb6b437e54 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:14.914858 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-07186754-368a-4ae8-923f-69fb6b437e54 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:14.915701 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-07186754-368a-4ae8-923f-69fb6b437e54 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:14.916211 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-07186754-368a-4ae8-923f-69fb6b437e54 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:15.055068 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-07186754-368a-4ae8-923f-69fb6b437e54 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:15.062472 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-07186754-368a-4ae8-923f-69fb6b437e54 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/1385abf2-5cb6-424f-9768-048d7f9efaac" status: 200 len: 1266 microversion: 2.1 time: 0.159246 Nov 23 09:05:15.063040 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 425/849] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:05:14 2021] GET /compute/v2.1/servers/1385abf2-5cb6-424f-9768-048d7f9efaac => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:05:15.354640 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-3882aca9-53b6-435d-922a-27dc955f9fd7 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:15.355277 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-3882aca9-53b6-435d-922a-27dc955f9fd7 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:15.361569 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3882aca9-53b6-435d-922a-27dc955f9fd7 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:15.362019 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3882aca9-53b6-435d-922a-27dc955f9fd7 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:15.362798 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3882aca9-53b6-435d-922a-27dc955f9fd7 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:15.363263 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3882aca9-53b6-435d-922a-27dc955f9fd7 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:15.492445 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-3882aca9-53b6-435d-922a-27dc955f9fd7 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:15.500137 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-3882aca9-53b6-435d-922a-27dc955f9fd7 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:15.501794 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-3882aca9-53b6-435d-922a-27dc955f9fd7 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:15.502947 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-3882aca9-53b6-435d-922a-27dc955f9fd7 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1716 microversion: 2.20 time: 0.152019 Nov 23 09:05:15.503513 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 425/850] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:05:15 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:05:16.079473 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-ac39bc7a-4cf0-46c4-ace3-02f684ea5d45 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:16.080086 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-ac39bc7a-4cf0-46c4-ace3-02f684ea5d45 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 1385abf2-5cb6-424f-9768-048d7f9efaac] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:16.087252 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ac39bc7a-4cf0-46c4-ace3-02f684ea5d45 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:16.087748 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ac39bc7a-4cf0-46c4-ace3-02f684ea5d45 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:16.088644 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ac39bc7a-4cf0-46c4-ace3-02f684ea5d45 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:16.089077 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ac39bc7a-4cf0-46c4-ace3-02f684ea5d45 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:16.220372 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-ac39bc7a-4cf0-46c4-ace3-02f684ea5d45 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:16.228223 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-ac39bc7a-4cf0-46c4-ace3-02f684ea5d45 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/1385abf2-5cb6-424f-9768-048d7f9efaac" status: 200 len: 1266 microversion: 2.1 time: 0.152363 Nov 23 09:05:16.228820 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 426/851] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:05:16 2021] GET /compute/v2.1/servers/1385abf2-5cb6-424f-9768-048d7f9efaac => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:05:17.244900 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-854e6cf5-fcd5-4f39-9e21-f59b30eb221a tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:17.245543 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-854e6cf5-fcd5-4f39-9e21-f59b30eb221a tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 1385abf2-5cb6-424f-9768-048d7f9efaac] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:17.251809 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-854e6cf5-fcd5-4f39-9e21-f59b30eb221a tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:17.252268 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-854e6cf5-fcd5-4f39-9e21-f59b30eb221a tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:17.253041 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-854e6cf5-fcd5-4f39-9e21-f59b30eb221a tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:17.253510 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-854e6cf5-fcd5-4f39-9e21-f59b30eb221a tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:17.380954 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-854e6cf5-fcd5-4f39-9e21-f59b30eb221a tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:17.388843 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-854e6cf5-fcd5-4f39-9e21-f59b30eb221a tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/1385abf2-5cb6-424f-9768-048d7f9efaac" status: 200 len: 1266 microversion: 2.1 time: 0.148320 Nov 23 09:05:17.389449 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 426/852] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:05:17 2021] GET /compute/v2.1/servers/1385abf2-5cb6-424f-9768-048d7f9efaac => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:05:18.405818 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-49124422-4a52-4141-92bc-fd96ace6fc52 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:18.406382 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-49124422-4a52-4141-92bc-fd96ace6fc52 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 1385abf2-5cb6-424f-9768-048d7f9efaac] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:18.412703 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-49124422-4a52-4141-92bc-fd96ace6fc52 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:18.413116 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-49124422-4a52-4141-92bc-fd96ace6fc52 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:18.413911 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-49124422-4a52-4141-92bc-fd96ace6fc52 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:18.414343 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-49124422-4a52-4141-92bc-fd96ace6fc52 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:18.542626 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-49124422-4a52-4141-92bc-fd96ace6fc52 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:18.549692 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-49124422-4a52-4141-92bc-fd96ace6fc52 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/1385abf2-5cb6-424f-9768-048d7f9efaac" status: 200 len: 1266 microversion: 2.1 time: 0.147533 Nov 23 09:05:18.550253 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 427/853] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:05:18 2021] GET /compute/v2.1/servers/1385abf2-5cb6-424f-9768-048d7f9efaac => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:05:19.566423 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-cc858c05-32af-476e-9c74-1b5a6e2af311 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:19.567023 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-cc858c05-32af-476e-9c74-1b5a6e2af311 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 1385abf2-5cb6-424f-9768-048d7f9efaac] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:19.573247 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-cc858c05-32af-476e-9c74-1b5a6e2af311 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:19.573697 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-cc858c05-32af-476e-9c74-1b5a6e2af311 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:19.574469 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-cc858c05-32af-476e-9c74-1b5a6e2af311 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:19.574899 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-cc858c05-32af-476e-9c74-1b5a6e2af311 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:19.707146 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-cc858c05-32af-476e-9c74-1b5a6e2af311 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:19.715389 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-cc858c05-32af-476e-9c74-1b5a6e2af311 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/1385abf2-5cb6-424f-9768-048d7f9efaac" status: 200 len: 1266 microversion: 2.1 time: 0.152561 Nov 23 09:05:19.715974 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 427/854] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:05:19 2021] GET /compute/v2.1/servers/1385abf2-5cb6-424f-9768-048d7f9efaac => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:05:20.732162 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-7453c3cf-970a-489b-89c9-421070154471 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:20.732763 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-7453c3cf-970a-489b-89c9-421070154471 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 1385abf2-5cb6-424f-9768-048d7f9efaac] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:20.739058 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7453c3cf-970a-489b-89c9-421070154471 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:20.739504 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7453c3cf-970a-489b-89c9-421070154471 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:20.740276 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7453c3cf-970a-489b-89c9-421070154471 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:20.741363 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7453c3cf-970a-489b-89c9-421070154471 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:20.871459 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-7453c3cf-970a-489b-89c9-421070154471 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:20.879076 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-7453c3cf-970a-489b-89c9-421070154471 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/1385abf2-5cb6-424f-9768-048d7f9efaac" status: 200 len: 1266 microversion: 2.1 time: 0.150476 Nov 23 09:05:20.879650 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 428/855] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:05:20 2021] GET /compute/v2.1/servers/1385abf2-5cb6-424f-9768-048d7f9efaac => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:05:21.383659 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-f2fafa32-e287-42f4-bc72-849f3d384039 req-80e7eb6b-06dd-44c3-aba5-728780c19b59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1385abf2-5cb6-424f-9768-048d7f9efaac", "name": "network-vif-plugged", "status": "completed", "tag": "833fdf90-74a3-408c-a75b-f0c5c196ddcf"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:05:21.385154 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:05:21.385154 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 09:05:21.392462 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-f2fafa32-e287-42f4-bc72-849f3d384039 req-80e7eb6b-06dd-44c3-aba5-728780c19b59 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:21.393096 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-f2fafa32-e287-42f4-bc72-849f3d384039 req-80e7eb6b-06dd-44c3-aba5-728780c19b59 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:21.404879 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-f2fafa32-e287-42f4-bc72-849f3d384039 req-80e7eb6b-06dd-44c3-aba5-728780c19b59 service nova] Creating event network-vif-plugged:833fdf90-74a3-408c-a75b-f0c5c196ddcf for instance 1385abf2-5cb6-424f-9768-048d7f9efaac on hv-cinder-76845 Nov 23 09:05:21.409839 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-f2fafa32-e287-42f4-bc72-849f3d384039 req-80e7eb6b-06dd-44c3-aba5-728780c19b59 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030374 Nov 23 09:05:21.410406 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 428/856] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:05:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:05:21.895322 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-1b0573d7-46ae-42ed-b00f-9bc7f284394e tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:21.895951 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-1b0573d7-46ae-42ed-b00f-9bc7f284394e tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 1385abf2-5cb6-424f-9768-048d7f9efaac] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:21.902878 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1b0573d7-46ae-42ed-b00f-9bc7f284394e tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:21.903322 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1b0573d7-46ae-42ed-b00f-9bc7f284394e tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:21.904095 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1b0573d7-46ae-42ed-b00f-9bc7f284394e tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:21.904525 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1b0573d7-46ae-42ed-b00f-9bc7f284394e tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:22.041426 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-1b0573d7-46ae-42ed-b00f-9bc7f284394e tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:22.048543 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-1b0573d7-46ae-42ed-b00f-9bc7f284394e tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/1385abf2-5cb6-424f-9768-048d7f9efaac" status: 200 len: 1266 microversion: 2.1 time: 0.156846 Nov 23 09:05:22.049112 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 429/857] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:05:21 2021] GET /compute/v2.1/servers/1385abf2-5cb6-424f-9768-048d7f9efaac => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:05:23.027070 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-8eda5516-6c44-4460-b4b0-557be3100705 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:05:23.028076 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-8eda5516-6c44-4460-b4b0-557be3100705 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:23.034200 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8eda5516-6c44-4460-b4b0-557be3100705 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:23.034652 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8eda5516-6c44-4460-b4b0-557be3100705 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:23.035427 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8eda5516-6c44-4460-b4b0-557be3100705 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:23.035868 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8eda5516-6c44-4460-b4b0-557be3100705 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:23.065532 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d65b3f6e-b57f-40f2-949f-34665c3a5545 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:23.066137 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d65b3f6e-b57f-40f2-949f-34665c3a5545 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 1385abf2-5cb6-424f-9768-048d7f9efaac] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:23.072960 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d65b3f6e-b57f-40f2-949f-34665c3a5545 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:23.073445 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d65b3f6e-b57f-40f2-949f-34665c3a5545 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:23.074227 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d65b3f6e-b57f-40f2-949f-34665c3a5545 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:23.074665 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d65b3f6e-b57f-40f2-949f-34665c3a5545 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:23.106701 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-8eda5516-6c44-4460-b4b0-557be3100705 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "POST /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84/action" status: 202 len: 0 microversion: 2.1 time: 0.084560 Nov 23 09:05:23.107333 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 429/858] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:05:23 2021] POST /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:05:23.116004 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-7ddb9b22-05ed-4e6f-9691-f12b3123796d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:23.116888 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-7ddb9b22-05ed-4e6f-9691-f12b3123796d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:23.123481 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7ddb9b22-05ed-4e6f-9691-f12b3123796d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:23.124065 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7ddb9b22-05ed-4e6f-9691-f12b3123796d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:23.125050 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7ddb9b22-05ed-4e6f-9691-f12b3123796d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:23.125538 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7ddb9b22-05ed-4e6f-9691-f12b3123796d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:23.250698 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d65b3f6e-b57f-40f2-949f-34665c3a5545 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:23.258673 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d65b3f6e-b57f-40f2-949f-34665c3a5545 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/1385abf2-5cb6-424f-9768-048d7f9efaac" status: 200 len: 1453 microversion: 2.1 time: 0.196812 Nov 23 09:05:23.270003 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 430/859] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:05:23 2021] GET /compute/v2.1/servers/1385abf2-5cb6-424f-9768-048d7f9efaac => generated 1453 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:05:23.275159 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-7ddb9b22-05ed-4e6f-9691-f12b3123796d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8695df9b3784afc8998af34694b942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d37eeef32a14dfcad683356d32556e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:23.276638 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-2e622555-d5be-4b05-b7cf-5f0c242bf499 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:23.277452 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-2e622555-d5be-4b05-b7cf-5f0c242bf499 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 1385abf2-5cb6-424f-9768-048d7f9efaac] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:23.283112 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-7ddb9b22-05ed-4e6f-9691-f12b3123796d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84" status: 200 len: 1751 microversion: 2.1 time: 0.171436 Nov 23 09:05:23.283613 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2e622555-d5be-4b05-b7cf-5f0c242bf499 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:23.283744 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 430/860] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:05:23 2021] GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84 => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:05:23.289925 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2e622555-d5be-4b05-b7cf-5f0c242bf499 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:23.290802 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2e622555-d5be-4b05-b7cf-5f0c242bf499 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:23.291242 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2e622555-d5be-4b05-b7cf-5f0c242bf499 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:23.486285 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-2e622555-d5be-4b05-b7cf-5f0c242bf499 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:23.493818 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-2e622555-d5be-4b05-b7cf-5f0c242bf499 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/1385abf2-5cb6-424f-9768-048d7f9efaac" status: 200 len: 1453 microversion: 2.1 time: 0.222580 Nov 23 09:05:23.494401 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 431/861] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:05:23 2021] GET /compute/v2.1/servers/1385abf2-5cb6-424f-9768-048d7f9efaac => generated 1453 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:05:24.301307 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-5cc812f0-8be0-4c38-9482-3dca659abd17 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:24.301952 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-5cc812f0-8be0-4c38-9482-3dca659abd17 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:24.308881 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5cc812f0-8be0-4c38-9482-3dca659abd17 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:24.309365 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5cc812f0-8be0-4c38-9482-3dca659abd17 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:24.310146 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5cc812f0-8be0-4c38-9482-3dca659abd17 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:24.310589 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5cc812f0-8be0-4c38-9482-3dca659abd17 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:24.758672 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-5cc812f0-8be0-4c38-9482-3dca659abd17 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8695df9b3784afc8998af34694b942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d37eeef32a14dfcad683356d32556e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:24.766329 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-5cc812f0-8be0-4c38-9482-3dca659abd17 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84" status: 200 len: 1756 microversion: 2.1 time: 0.468666 Nov 23 09:05:24.766900 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 431/862] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:05:24 2021] GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84 => generated 1756 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:05:25.391453 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-980b3a70-9947-4c81-83b3-1f003cb63fd5 req-f5ecc159-3a45-47fe-9372-324fd12351c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1385abf2-5cb6-424f-9768-048d7f9efaac", "tag": "833fdf90-74a3-408c-a75b-f0c5c196ddcf"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:05:25.392506 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:05:25.392506 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 09:05:25.400625 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-980b3a70-9947-4c81-83b3-1f003cb63fd5 req-f5ecc159-3a45-47fe-9372-324fd12351c7 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:25.401013 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-980b3a70-9947-4c81-83b3-1f003cb63fd5 req-f5ecc159-3a45-47fe-9372-324fd12351c7 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:25.411869 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-980b3a70-9947-4c81-83b3-1f003cb63fd5 req-f5ecc159-3a45-47fe-9372-324fd12351c7 service nova] Creating event network-changed:833fdf90-74a3-408c-a75b-f0c5c196ddcf for instance 1385abf2-5cb6-424f-9768-048d7f9efaac on hv-cinder-76845 Nov 23 09:05:25.417834 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-980b3a70-9947-4c81-83b3-1f003cb63fd5 req-f5ecc159-3a45-47fe-9372-324fd12351c7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030456 Nov 23 09:05:25.418680 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 432/863] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:05:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:05:25.783730 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-877ee2b4-7b65-40fd-9c3d-a04502f27fd7 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:25.784704 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-877ee2b4-7b65-40fd-9c3d-a04502f27fd7 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:25.792758 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-877ee2b4-7b65-40fd-9c3d-a04502f27fd7 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:25.793386 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-877ee2b4-7b65-40fd-9c3d-a04502f27fd7 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:25.794761 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-877ee2b4-7b65-40fd-9c3d-a04502f27fd7 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:25.794761 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-877ee2b4-7b65-40fd-9c3d-a04502f27fd7 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:25.943810 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-877ee2b4-7b65-40fd-9c3d-a04502f27fd7 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8695df9b3784afc8998af34694b942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d37eeef32a14dfcad683356d32556e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:25.952661 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-877ee2b4-7b65-40fd-9c3d-a04502f27fd7 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84" status: 200 len: 1756 microversion: 2.1 time: 0.172383 Nov 23 09:05:25.953264 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 432/864] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:05:25 2021] GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:05:26.971122 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-6dd13a35-3600-4577-a9c2-5bbfcf88221c tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:26.971820 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-6dd13a35-3600-4577-a9c2-5bbfcf88221c tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:26.978094 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6dd13a35-3600-4577-a9c2-5bbfcf88221c tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:26.978542 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6dd13a35-3600-4577-a9c2-5bbfcf88221c tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:26.979357 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6dd13a35-3600-4577-a9c2-5bbfcf88221c tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:26.979795 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6dd13a35-3600-4577-a9c2-5bbfcf88221c tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:27.125598 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-6dd13a35-3600-4577-a9c2-5bbfcf88221c tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8695df9b3784afc8998af34694b942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d37eeef32a14dfcad683356d32556e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:27.134094 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-6dd13a35-3600-4577-a9c2-5bbfcf88221c tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84" status: 200 len: 1756 microversion: 2.1 time: 0.167479 Nov 23 09:05:27.134663 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 433/865] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:05:26 2021] GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:05:28.151699 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-09e2dd7d-2071-475a-9d1c-87de51c591f1 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:28.152310 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-09e2dd7d-2071-475a-9d1c-87de51c591f1 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:28.158667 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-09e2dd7d-2071-475a-9d1c-87de51c591f1 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:28.159124 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-09e2dd7d-2071-475a-9d1c-87de51c591f1 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:28.159908 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-09e2dd7d-2071-475a-9d1c-87de51c591f1 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:28.160349 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-09e2dd7d-2071-475a-9d1c-87de51c591f1 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:28.298696 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-09e2dd7d-2071-475a-9d1c-87de51c591f1 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8695df9b3784afc8998af34694b942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d37eeef32a14dfcad683356d32556e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:28.307366 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-09e2dd7d-2071-475a-9d1c-87de51c591f1 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84" status: 200 len: 1756 microversion: 2.1 time: 0.159958 Nov 23 09:05:28.307931 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 433/866] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:05:28 2021] GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84 => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:05:29.323556 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-80b995c3-990f-474b-80a9-5550ef6f4a3d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:29.324159 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-80b995c3-990f-474b-80a9-5550ef6f4a3d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:29.330091 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-80b995c3-990f-474b-80a9-5550ef6f4a3d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:29.330533 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-80b995c3-990f-474b-80a9-5550ef6f4a3d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:29.331297 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-80b995c3-990f-474b-80a9-5550ef6f4a3d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:29.331726 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-80b995c3-990f-474b-80a9-5550ef6f4a3d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:29.470074 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-80b995c3-990f-474b-80a9-5550ef6f4a3d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8695df9b3784afc8998af34694b942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d37eeef32a14dfcad683356d32556e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:29.478299 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-80b995c3-990f-474b-80a9-5550ef6f4a3d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84" status: 200 len: 1756 microversion: 2.1 time: 0.158422 Nov 23 09:05:29.478863 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 434/867] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:05:29 2021] GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84 => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:05:30.496928 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-7426dc9d-310f-4e28-95a7-44b68359356c tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:30.497562 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-7426dc9d-310f-4e28-95a7-44b68359356c tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:30.503852 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7426dc9d-310f-4e28-95a7-44b68359356c tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:30.504301 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7426dc9d-310f-4e28-95a7-44b68359356c tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:30.505068 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7426dc9d-310f-4e28-95a7-44b68359356c tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:30.505571 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7426dc9d-310f-4e28-95a7-44b68359356c tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:30.648618 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-7426dc9d-310f-4e28-95a7-44b68359356c tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8695df9b3784afc8998af34694b942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d37eeef32a14dfcad683356d32556e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:30.656731 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-7426dc9d-310f-4e28-95a7-44b68359356c tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84" status: 200 len: 1756 microversion: 2.1 time: 0.163661 Nov 23 09:05:30.657328 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 434/868] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:05:30 2021] GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:05:31.674196 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b680e0f8-a9c9-4b64-b996-99d00ecbc93d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:31.674720 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b680e0f8-a9c9-4b64-b996-99d00ecbc93d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:31.680862 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b680e0f8-a9c9-4b64-b996-99d00ecbc93d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:31.681348 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b680e0f8-a9c9-4b64-b996-99d00ecbc93d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:31.682117 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b680e0f8-a9c9-4b64-b996-99d00ecbc93d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:31.682548 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b680e0f8-a9c9-4b64-b996-99d00ecbc93d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:31.823403 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b680e0f8-a9c9-4b64-b996-99d00ecbc93d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8695df9b3784afc8998af34694b942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d37eeef32a14dfcad683356d32556e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:31.831083 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b680e0f8-a9c9-4b64-b996-99d00ecbc93d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84" status: 200 len: 1756 microversion: 2.1 time: 0.160637 Nov 23 09:05:31.831648 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 435/869] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:05:31 2021] GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:05:32.848858 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-706bd038-3cb5-42f3-bffc-e591fa0a38a2 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:32.849499 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-706bd038-3cb5-42f3-bffc-e591fa0a38a2 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:32.856431 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-706bd038-3cb5-42f3-bffc-e591fa0a38a2 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:32.856888 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-706bd038-3cb5-42f3-bffc-e591fa0a38a2 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:32.857704 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-706bd038-3cb5-42f3-bffc-e591fa0a38a2 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:32.858150 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-706bd038-3cb5-42f3-bffc-e591fa0a38a2 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:32.996255 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-706bd038-3cb5-42f3-bffc-e591fa0a38a2 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8695df9b3784afc8998af34694b942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d37eeef32a14dfcad683356d32556e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:33.003925 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-706bd038-3cb5-42f3-bffc-e591fa0a38a2 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84" status: 200 len: 1756 microversion: 2.1 time: 0.158676 Nov 23 09:05:33.004488 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 435/870] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:05:32 2021] GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84 => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:05:34.020375 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-25a86606-6912-41d8-9ba6-d2f0c056edce tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:34.020988 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-25a86606-6912-41d8-9ba6-d2f0c056edce tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:34.027907 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-25a86606-6912-41d8-9ba6-d2f0c056edce tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:34.028362 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-25a86606-6912-41d8-9ba6-d2f0c056edce tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:34.029139 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-25a86606-6912-41d8-9ba6-d2f0c056edce tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:34.029602 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-25a86606-6912-41d8-9ba6-d2f0c056edce tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:34.168196 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-25a86606-6912-41d8-9ba6-d2f0c056edce tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8695df9b3784afc8998af34694b942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d37eeef32a14dfcad683356d32556e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:34.175973 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-25a86606-6912-41d8-9ba6-d2f0c056edce tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84" status: 200 len: 1756 microversion: 2.1 time: 0.159243 Nov 23 09:05:34.176545 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 436/871] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:05:34 2021] GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84 => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:05:35.192896 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-5e8ccf13-bbbc-40aa-9874-3daa8eabe585 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:35.193454 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-5e8ccf13-bbbc-40aa-9874-3daa8eabe585 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:35.200469 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5e8ccf13-bbbc-40aa-9874-3daa8eabe585 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:35.200918 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5e8ccf13-bbbc-40aa-9874-3daa8eabe585 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:35.201724 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5e8ccf13-bbbc-40aa-9874-3daa8eabe585 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:35.202161 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5e8ccf13-bbbc-40aa-9874-3daa8eabe585 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:35.345502 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-5e8ccf13-bbbc-40aa-9874-3daa8eabe585 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8695df9b3784afc8998af34694b942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d37eeef32a14dfcad683356d32556e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:35.353272 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-5e8ccf13-bbbc-40aa-9874-3daa8eabe585 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84" status: 200 len: 1759 microversion: 2.1 time: 0.164091 Nov 23 09:05:35.353841 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 436/872] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:05:35 2021] GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84 => generated 1759 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:05:53.774250 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e9615231-4385-4858-9a07-745a027ae8b0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:53.775206 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e9615231-4385-4858-9a07-745a027ae8b0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:53.781636 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e9615231-4385-4858-9a07-745a027ae8b0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:53.782088 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e9615231-4385-4858-9a07-745a027ae8b0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:53.782868 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e9615231-4385-4858-9a07-745a027ae8b0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:53.783303 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e9615231-4385-4858-9a07-745a027ae8b0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:53.811942 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e9615231-4385-4858-9a07-745a027ae8b0 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041484 Nov 23 09:05:53.812512 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 437/873] 10.222.0.46 () {60 vars in 1342 bytes} [Tue Nov 23 09:05:53 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:05:53.869468 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-693fa725-146d-4c06-aae0-bdc1980fa992 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:53.869991 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-693fa725-146d-4c06-aae0-bdc1980fa992 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:53.875689 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-693fa725-146d-4c06-aae0-bdc1980fa992 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:53.876141 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-693fa725-146d-4c06-aae0-bdc1980fa992 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:53.876910 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-693fa725-146d-4c06-aae0-bdc1980fa992 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:53.877371 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-693fa725-146d-4c06-aae0-bdc1980fa992 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:53.901402 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-693fa725-146d-4c06-aae0-bdc1980fa992 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Going to try to terminate instance {{(pid=116227) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 09:05:53.973438 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-693fa725-146d-4c06-aae0-bdc1980fa992 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "DELETE /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 204 len: 0 microversion: 2.20 time: 0.108031 Nov 23 09:05:53.974122 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 437/874] 10.222.0.46 () {60 vars in 1279 bytes} [Tue Nov 23 09:05:53 2021] DELETE /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 23 09:05:53.983298 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-1a659366-a24e-48e6-b92f-2a4ad5dcb73a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:53.983836 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-1a659366-a24e-48e6-b92f-2a4ad5dcb73a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:53.989647 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1a659366-a24e-48e6-b92f-2a4ad5dcb73a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:53.990100 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1a659366-a24e-48e6-b92f-2a4ad5dcb73a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:53.990876 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1a659366-a24e-48e6-b92f-2a4ad5dcb73a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:53.991333 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1a659366-a24e-48e6-b92f-2a4ad5dcb73a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:54.131630 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-1a659366-a24e-48e6-b92f-2a4ad5dcb73a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:54.139725 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-1a659366-a24e-48e6-b92f-2a4ad5dcb73a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:54.141266 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-1a659366-a24e-48e6-b92f-2a4ad5dcb73a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:54.142417 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-1a659366-a24e-48e6-b92f-2a4ad5dcb73a tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1722 microversion: 2.20 time: 0.162973 Nov 23 09:05:54.142975 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 438/875] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:05:53 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 09:05:55.161692 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-3843b3d6-8a1a-430d-a45c-fddf33ef14f5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:55.162395 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-3843b3d6-8a1a-430d-a45c-fddf33ef14f5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:55.169190 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3843b3d6-8a1a-430d-a45c-fddf33ef14f5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:55.169658 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3843b3d6-8a1a-430d-a45c-fddf33ef14f5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:55.170514 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3843b3d6-8a1a-430d-a45c-fddf33ef14f5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:55.170951 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3843b3d6-8a1a-430d-a45c-fddf33ef14f5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:55.305416 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-3843b3d6-8a1a-430d-a45c-fddf33ef14f5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:55.313069 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-3843b3d6-8a1a-430d-a45c-fddf33ef14f5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:55.314599 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-3843b3d6-8a1a-430d-a45c-fddf33ef14f5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:55.315854 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-3843b3d6-8a1a-430d-a45c-fddf33ef14f5 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1722 microversion: 2.20 time: 0.158444 Nov 23 09:05:55.316908 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 438/876] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:05:55 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:05:56.335516 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-61bfbe18-e933-4a6a-8ee6-e2a3ef423e7c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:56.336667 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-61bfbe18-e933-4a6a-8ee6-e2a3ef423e7c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:56.344439 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-1819eb05-c795-4eee-a3b7-b39375bc8445 req-fcc70776-6613-4569-8ed4-f722f57e848e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33d3a8a8-651e-4b5e-ac3a-2032c9d60800", "name": "network-vif-deleted", "tag": "9c88cc6d-9402-4eb1-bcaf-c79ca859d7c3"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:05:56.346110 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:05:56.346110 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 09:05:56.352885 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-61bfbe18-e933-4a6a-8ee6-e2a3ef423e7c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:56.353317 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-61bfbe18-e933-4a6a-8ee6-e2a3ef423e7c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:56.354122 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-61bfbe18-e933-4a6a-8ee6-e2a3ef423e7c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:56.354459 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-1819eb05-c795-4eee-a3b7-b39375bc8445 req-fcc70776-6613-4569-8ed4-f722f57e848e service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:56.354615 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-61bfbe18-e933-4a6a-8ee6-e2a3ef423e7c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:56.355229 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-1819eb05-c795-4eee-a3b7-b39375bc8445 req-fcc70776-6613-4569-8ed4-f722f57e848e service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:56.368258 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-1819eb05-c795-4eee-a3b7-b39375bc8445 req-fcc70776-6613-4569-8ed4-f722f57e848e service nova] Creating event network-vif-deleted:9c88cc6d-9402-4eb1-bcaf-c79ca859d7c3 for instance 33d3a8a8-651e-4b5e-ac3a-2032c9d60800 on hv-cinder-76845 Nov 23 09:05:56.373532 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-1819eb05-c795-4eee-a3b7-b39375bc8445 req-fcc70776-6613-4569-8ed4-f722f57e848e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032558 Nov 23 09:05:56.374377 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 439/877] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:05:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 09:05:56.427331 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-61bfbe18-e933-4a6a-8ee6-e2a3ef423e7c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:56.438738 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-61bfbe18-e933-4a6a-8ee6-e2a3ef423e7c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:56.440162 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-61bfbe18-e933-4a6a-8ee6-e2a3ef423e7c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'deddc2bd931e42168ab8f2256a77fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25886501fbd4758b06603593508fd2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:05:56.441832 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-61bfbe18-e933-4a6a-8ee6-e2a3ef423e7c tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 200 len: 1655 microversion: 2.20 time: 0.110430 Nov 23 09:05:56.442921 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 439/878] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:05:56 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 1655 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 09:05:57.464851 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-e7419c1d-8c22-4ad5-8a60-dd31cb8b3338 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:57.465896 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-e7419c1d-8c22-4ad5-8a60-dd31cb8b3338 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:57.473138 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e7419c1d-8c22-4ad5-8a60-dd31cb8b3338 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:57.473615 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e7419c1d-8c22-4ad5-8a60-dd31cb8b3338 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:57.474403 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e7419c1d-8c22-4ad5-8a60-dd31cb8b3338 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:57.474844 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e7419c1d-8c22-4ad5-8a60-dd31cb8b3338 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:57.489901 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.wsgi [None req-e7419c1d-8c22-4ad5-8a60-dd31cb8b3338 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] HTTP exception thrown: Instance 33d3a8a8-651e-4b5e-ac3a-2032c9d60800 could not be found. Nov 23 09:05:57.490499 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-e7419c1d-8c22-4ad5-8a60-dd31cb8b3338 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Returning 404 to user: Instance 33d3a8a8-651e-4b5e-ac3a-2032c9d60800 could not be found. {{(pid=116227) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 09:05:57.491836 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-e7419c1d-8c22-4ad5-8a60-dd31cb8b3338 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 404 len: 111 microversion: 2.20 time: 0.033495 Nov 23 09:05:57.492393 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 440/879] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 23 09:05:57 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 23 09:05:57.500798 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e7d9de75-74c7-4143-a275-4c8fc290df7f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '.version_select at 0x7f527a314430>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:57.519595 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e7d9de75-74c7-4143-a275-4c8fc290df7f tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1713030377" status: 204 len: 0 microversion: 2.20 time: 0.022506 Nov 23 09:05:57.520167 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 440/880] 10.222.0.46 () {60 vars in 1261 bytes} [Tue Nov 23 09:05:57 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1713030377 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 23 09:05:59.279317 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-f1bdc048-4e30-4ffb-b04d-6ca41f5a51d2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:59.279803 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-f1bdc048-4e30-4ffb-b04d-6ca41f5a51d2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:59.286300 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f1bdc048-4e30-4ffb-b04d-6ca41f5a51d2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:59.286749 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f1bdc048-4e30-4ffb-b04d-6ca41f5a51d2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:59.287521 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f1bdc048-4e30-4ffb-b04d-6ca41f5a51d2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:59.288435 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f1bdc048-4e30-4ffb-b04d-6ca41f5a51d2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:59.301488 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.wsgi [None req-f1bdc048-4e30-4ffb-b04d-6ca41f5a51d2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] HTTP exception thrown: Instance 33d3a8a8-651e-4b5e-ac3a-2032c9d60800 could not be found. Nov 23 09:05:59.302059 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-f1bdc048-4e30-4ffb-b04d-6ca41f5a51d2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Returning 404 to user: Instance 33d3a8a8-651e-4b5e-ac3a-2032c9d60800 could not be found. {{(pid=116227) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 09:05:59.302859 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-f1bdc048-4e30-4ffb-b04d-6ca41f5a51d2 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "DELETE /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 404 len: 111 microversion: 2.1 time: 0.027168 Nov 23 09:05:59.303381 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 441/881] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 23 09:05:59 2021] DELETE /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 09:05:59.312094 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-9bb117dd-e0eb-4424-a77e-b14e189aad78 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:05:59.312705 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-9bb117dd-e0eb-4424-a77e-b14e189aad78 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 33d3a8a8-651e-4b5e-ac3a-2032c9d60800] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:05:59.319231 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9bb117dd-e0eb-4424-a77e-b14e189aad78 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:59.319686 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9bb117dd-e0eb-4424-a77e-b14e189aad78 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:59.320456 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9bb117dd-e0eb-4424-a77e-b14e189aad78 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:05:59.320891 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9bb117dd-e0eb-4424-a77e-b14e189aad78 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:05:59.333392 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-9bb117dd-e0eb-4424-a77e-b14e189aad78 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] HTTP exception thrown: Instance 33d3a8a8-651e-4b5e-ac3a-2032c9d60800 could not be found. Nov 23 09:05:59.333971 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-9bb117dd-e0eb-4424-a77e-b14e189aad78 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Returning 404 to user: Instance 33d3a8a8-651e-4b5e-ac3a-2032c9d60800 could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 09:05:59.335177 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-9bb117dd-e0eb-4424-a77e-b14e189aad78 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800" status: 404 len: 111 microversion: 2.1 time: 0.027046 Nov 23 09:05:59.335777 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 441/882] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:05:59 2021] GET /compute/v2.1/servers/33d3a8a8-651e-4b5e-ac3a-2032c9d60800 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 09:06:00.459494 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-69a3bbf6-789f-4559-8216-e579fe7a6308 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:06:00.460607 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-69a3bbf6-789f-4559-8216-e579fe7a6308 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:00.466967 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-69a3bbf6-789f-4559-8216-e579fe7a6308 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:00.467422 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-69a3bbf6-789f-4559-8216-e579fe7a6308 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:00.468198 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-69a3bbf6-789f-4559-8216-e579fe7a6308 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:00.468634 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-69a3bbf6-789f-4559-8216-e579fe7a6308 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:00.482302 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.wsgi [None req-69a3bbf6-789f-4559-8216-e579fe7a6308 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] HTTP exception thrown: Instance 82569d71-833c-454b-a668-12dc9a37e7e2 could not be found. Nov 23 09:06:00.482889 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-69a3bbf6-789f-4559-8216-e579fe7a6308 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Returning 404 to user: Instance 82569d71-833c-454b-a668-12dc9a37e7e2 could not be found. {{(pid=116227) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 09:06:00.483705 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-69a3bbf6-789f-4559-8216-e579fe7a6308 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "DELETE /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 404 len: 111 microversion: 2.1 time: 0.028303 Nov 23 09:06:00.484281 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 442/883] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 23 09:06:00 2021] DELETE /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 09:06:00.492406 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-78f87ecb-de0d-4b66-a684-32fa6f745285 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:06:00.493108 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-78f87ecb-de0d-4b66-a684-32fa6f745285 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] [instance: 82569d71-833c-454b-a668-12dc9a37e7e2] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:00.499479 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-78f87ecb-de0d-4b66-a684-32fa6f745285 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:00.499936 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-78f87ecb-de0d-4b66-a684-32fa6f745285 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:00.500721 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-78f87ecb-de0d-4b66-a684-32fa6f745285 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:00.501177 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-78f87ecb-de0d-4b66-a684-32fa6f745285 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:00.514307 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-78f87ecb-de0d-4b66-a684-32fa6f745285 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] HTTP exception thrown: Instance 82569d71-833c-454b-a668-12dc9a37e7e2 could not be found. Nov 23 09:06:00.514887 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-78f87ecb-de0d-4b66-a684-32fa6f745285 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] Returning 404 to user: Instance 82569d71-833c-454b-a668-12dc9a37e7e2 could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 09:06:00.515707 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-78f87ecb-de0d-4b66-a684-32fa6f745285 tempest-AttachVolumeShelveTestJSON-1381431558 tempest-AttachVolumeShelveTestJSON-1381431558-project] 10.222.0.46 "GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2" status: 404 len: 111 microversion: 2.1 time: 0.027388 Nov 23 09:06:00.516258 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 442/884] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:06:00 2021] GET /compute/v2.1/servers/82569d71-833c-454b-a668-12dc9a37e7e2 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 09:06:09.015002 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-6414605c-f2a5-4660-9a7d-955fde8b8e53 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'create', calling method: .version_select at 0x7f527a291820>, body: {"keypair": {"name": "tempest-keypair-1681989018"}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:09.034265 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.quota [None req-6414605c-f2a5-4660-9a7d-955fde8b8e53 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Getting quotas for project 35872f178d144e849752bc7a845cb40d. Resources: {'key_pairs'} {{(pid=116227) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 09:06:09.038669 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.quota [None req-6414605c-f2a5-4660-9a7d-955fde8b8e53 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Getting quotas for user 06d848da2c21474b992041ca82e1d5e7 and project 35872f178d144e849752bc7a845cb40d. Resources: {'key_pairs'} {{(pid=116227) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 09:06:09.225939 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.quota [None req-6414605c-f2a5-4660-9a7d-955fde8b8e53 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Getting quotas for project 35872f178d144e849752bc7a845cb40d. Resources: {'key_pairs'} {{(pid=116227) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 09:06:09.230761 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.quota [None req-6414605c-f2a5-4660-9a7d-955fde8b8e53 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Getting quotas for user 06d848da2c21474b992041ca82e1d5e7 and project 35872f178d144e849752bc7a845cb40d. Resources: {'key_pairs'} {{(pid=116227) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 09:06:09.244708 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-6414605c-f2a5-4660-9a7d-955fde8b8e53 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.355779 Nov 23 09:06:09.245340 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 443/885] 10.222.0.46 () {60 vars in 1157 bytes} [Tue Nov 23 09:06:08 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:06:10.497672 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-1fe5805c-9b25-49ca-a4a4-937897991e02 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1011172835", "imageRef": "18424a16-ac32-42d5-8161-d6cb36423de3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c9e1bbdd-99f7-422e-846d-8219534d04c4"}], "security_groups": [{"name": "tempest-securitygroup--2102799189"}], "key_name": "tempest-keypair-1681989018", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:10.604760 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.network.neutron [None req-1fe5805c-9b25-49ca-a4a4-937897991e02 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] validate_networks() for [('c9e1bbdd-99f7-422e-846d-8219534d04c4', None, None, None, None, None)] {{(pid=116226) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 09:06:10.998491 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-1fe5805c-9b25-49ca-a4a4-937897991e02 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Flavor limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 09:06:10.998918 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-1fe5805c-9b25-49ca-a4a4-937897991e02 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Image limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 09:06:10.999398 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-1fe5805c-9b25-49ca-a4a4-937897991e02 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Flavor pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 09:06:10.999812 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-1fe5805c-9b25-49ca-a4a4-937897991e02 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Image pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 09:06:11.000228 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-1fe5805c-9b25-49ca-a4a4-937897991e02 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 09:06:11.010351 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1fe5805c-9b25-49ca-a4a4-937897991e02 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:11.011042 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1fe5805c-9b25-49ca-a4a4-937897991e02 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:11.012060 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1fe5805c-9b25-49ca-a4a4-937897991e02 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:11.012678 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1fe5805c-9b25-49ca-a4a4-937897991e02 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:11.036074 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-1fe5805c-9b25-49ca-a4a4-937897991e02 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Getting quotas for project 35872f178d144e849752bc7a845cb40d. Resources: {'instances', 'ram', 'cores'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 09:06:11.040880 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-1fe5805c-9b25-49ca-a4a4-937897991e02 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Getting quotas for user 06d848da2c21474b992041ca82e1d5e7 and project 35872f178d144e849752bc7a845cb40d. Resources: {'instances', 'ram', 'cores'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 09:06:11.052376 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-1fe5805c-9b25-49ca-a4a4-937897991e02 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Going to run 1 instances... {{(pid=116226) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 09:06:11.055817 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-1fe5805c-9b25-49ca-a4a4-937897991e02 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='18424a16-ac32-42d5-8161-d6cb36423de3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116226) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 09:06:11.115707 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-1fe5805c-9b25-49ca-a4a4-937897991e02 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.622025 Nov 23 09:06:11.125318 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 443/886] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 23 09:06:10 2021] POST /compute/v2.1/servers => generated 402 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 09:06:11.128680 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-3fbc18a6-2fa5-4571-b7bd-24f48c68f530 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:06:11.140902 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-3fbc18a6-2fa5-4571-b7bd-24f48c68f530 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:11.213414 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-3fbc18a6-2fa5-4571-b7bd-24f48c68f530 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:06:11.220321 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-3fbc18a6-2fa5-4571-b7bd-24f48c68f530 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1238 microversion: 2.1 time: 0.095859 Nov 23 09:06:11.220891 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 444/887] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:06:11 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1238 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:06:12.239260 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-997ae7e4-40b5-436c-b0e4-0db04c1e9204 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:06:12.239937 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-997ae7e4-40b5-436c-b0e4-0db04c1e9204 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:12.248479 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-997ae7e4-40b5-436c-b0e4-0db04c1e9204 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:12.249154 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-997ae7e4-40b5-436c-b0e4-0db04c1e9204 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:12.250306 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-997ae7e4-40b5-436c-b0e4-0db04c1e9204 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:12.250767 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-997ae7e4-40b5-436c-b0e4-0db04c1e9204 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:12.352569 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-997ae7e4-40b5-436c-b0e4-0db04c1e9204 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:06:12.360577 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-997ae7e4-40b5-436c-b0e4-0db04c1e9204 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1296 microversion: 2.1 time: 0.126797 Nov 23 09:06:12.361354 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 444/888] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:06:12 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1296 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:06:13.377460 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-a6a051fd-5ce3-46cc-8cdc-b032239b1e13 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:06:13.378181 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-a6a051fd-5ce3-46cc-8cdc-b032239b1e13 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:13.385190 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a6a051fd-5ce3-46cc-8cdc-b032239b1e13 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:13.385732 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a6a051fd-5ce3-46cc-8cdc-b032239b1e13 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:13.386599 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a6a051fd-5ce3-46cc-8cdc-b032239b1e13 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:13.387102 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a6a051fd-5ce3-46cc-8cdc-b032239b1e13 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:13.522203 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-a6a051fd-5ce3-46cc-8cdc-b032239b1e13 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:06:13.530278 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-a6a051fd-5ce3-46cc-8cdc-b032239b1e13 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1364 microversion: 2.1 time: 0.156256 Nov 23 09:06:13.530896 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 445/889] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:06:13 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:06:13.734991 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-7d6de350-5bff-4beb-a387-05482f647e57 req-a307cf39-e566-410d-9bda-90c7d53dfc60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab769fa8-d310-4b1c-be00-7d2ded9d51a8", "tag": "92ef3c22-1299-429d-a178-f4715346a0f5"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:13.737465 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:06:13.737465 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 09:06:13.751164 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-7d6de350-5bff-4beb-a387-05482f647e57 req-a307cf39-e566-410d-9bda-90c7d53dfc60 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:13.751776 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-7d6de350-5bff-4beb-a387-05482f647e57 req-a307cf39-e566-410d-9bda-90c7d53dfc60 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:13.766028 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-7d6de350-5bff-4beb-a387-05482f647e57 req-a307cf39-e566-410d-9bda-90c7d53dfc60 service nova] Creating event network-changed:92ef3c22-1299-429d-a178-f4715346a0f5 for instance ab769fa8-d310-4b1c-be00-7d2ded9d51a8 on hv-cinder-76845 Nov 23 09:06:13.771052 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-7d6de350-5bff-4beb-a387-05482f647e57 req-a307cf39-e566-410d-9bda-90c7d53dfc60 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040815 Nov 23 09:06:13.773030 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 445/890] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:06:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:06:13.858043 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-03d19d01-64f3-4437-bb5b-cc55bdd3ccc5 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1724034427"}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:13.858578 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-03d19d01-64f3-4437-bb5b-cc55bdd3ccc5 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:13.864643 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-03d19d01-64f3-4437-bb5b-cc55bdd3ccc5 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:13.865097 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-03d19d01-64f3-4437-bb5b-cc55bdd3ccc5 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:13.866018 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-03d19d01-64f3-4437-bb5b-cc55bdd3ccc5 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:13.866629 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-03d19d01-64f3-4437-bb5b-cc55bdd3ccc5 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:13.999042 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.network.security_group_api [None req-03d19d01-64f3-4437-bb5b-cc55bdd3ccc5 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Removing security group 6101f722-11cd-4dbd-86cc-954bf7e2d4d0 from port c2e5dcf0-fb18-4cc4-9002-cb7aa635b9b7 Nov 23 09:06:14.348906 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-03d19d01-64f3-4437-bb5b-cc55bdd3ccc5 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "POST /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84/action" status: 202 len: 0 microversion: 2.1 time: 0.494533 Nov 23 09:06:14.353463 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 446/891] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:06:13 2021] POST /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84/action => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:06:14.362103 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-f0f7dc82-041d-4610-9ba2-6a590b4e90c6 req-225f6a60-f7a5-4ca4-a153-c0262e4efd33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b24efc8-4126-486b-92cf-3975dc60bd84", "tag": "c2e5dcf0-fb18-4cc4-9002-cb7aa635b9b7"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:14.363708 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:06:14.363708 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 09:06:14.380100 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-f0f7dc82-041d-4610-9ba2-6a590b4e90c6 req-225f6a60-f7a5-4ca4-a153-c0262e4efd33 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:14.380807 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-f0f7dc82-041d-4610-9ba2-6a590b4e90c6 req-225f6a60-f7a5-4ca4-a153-c0262e4efd33 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:14.406407 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-f0f7dc82-041d-4610-9ba2-6a590b4e90c6 req-225f6a60-f7a5-4ca4-a153-c0262e4efd33 service nova] Creating event network-changed:c2e5dcf0-fb18-4cc4-9002-cb7aa635b9b7 for instance 0b24efc8-4126-486b-92cf-3975dc60bd84 on hv-cinder-76845 Nov 23 09:06:14.418178 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-f0f7dc82-041d-4610-9ba2-6a590b4e90c6 req-225f6a60-f7a5-4ca4-a153-c0262e4efd33 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059972 Nov 23 09:06:14.419456 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 446/892] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:06:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 09:06:14.547350 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-57e7d50a-5dce-4d6b-8d14-fe4406510a3d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:06:14.547970 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-57e7d50a-5dce-4d6b-8d14-fe4406510a3d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:14.558330 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-57e7d50a-5dce-4d6b-8d14-fe4406510a3d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:14.559050 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-57e7d50a-5dce-4d6b-8d14-fe4406510a3d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:14.561436 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-57e7d50a-5dce-4d6b-8d14-fe4406510a3d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:14.561905 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-57e7d50a-5dce-4d6b-8d14-fe4406510a3d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:14.950474 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-57e7d50a-5dce-4d6b-8d14-fe4406510a3d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:06:14.957704 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-57e7d50a-5dce-4d6b-8d14-fe4406510a3d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1364 microversion: 2.1 time: 0.414545 Nov 23 09:06:14.958279 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 447/893] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:06:14 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1364 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:06:15.884836 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-0fcd83aa-1e53-442c-9f58-8747ee5ae52d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:06:15.885481 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-0fcd83aa-1e53-442c-9f58-8747ee5ae52d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:15.891720 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0fcd83aa-1e53-442c-9f58-8747ee5ae52d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:15.892163 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0fcd83aa-1e53-442c-9f58-8747ee5ae52d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:15.892962 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0fcd83aa-1e53-442c-9f58-8747ee5ae52d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:15.893418 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0fcd83aa-1e53-442c-9f58-8747ee5ae52d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:15.973378 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.objects.instance [None req-0fcd83aa-1e53-442c-9f58-8747ee5ae52d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lazy-loading 'services' on Instance uuid 0b24efc8-4126-486b-92cf-3975dc60bd84 {{(pid=116226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 09:06:15.975857 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-ed1e91a6-cc14-4480-b436-307f90896b48 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:06:15.976599 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-ed1e91a6-cc14-4480-b436-307f90896b48 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:15.982946 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ed1e91a6-cc14-4480-b436-307f90896b48 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:15.983512 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ed1e91a6-cc14-4480-b436-307f90896b48 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:15.984404 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ed1e91a6-cc14-4480-b436-307f90896b48 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:15.985077 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ed1e91a6-cc14-4480-b436-307f90896b48 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:16.051364 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-0fcd83aa-1e53-442c-9f58-8747ee5ae52d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84/os-volume_attachments/968c3cd2-7658-4a92-92ef-c68773831307" status: 202 len: 0 microversion: 2.1 time: 0.172709 Nov 23 09:06:16.051965 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 447/894] 10.222.0.46 () {58 vars in 1415 bytes} [Tue Nov 23 09:06:15 2021] DELETE /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84/os-volume_attachments/968c3cd2-7658-4a92-92ef-c68773831307 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:06:16.064161 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-86b5a7cc-8f83-4c6b-9a75-30a11368b52f tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:06:16.065327 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-86b5a7cc-8f83-4c6b-9a75-30a11368b52f tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:16.072807 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-86b5a7cc-8f83-4c6b-9a75-30a11368b52f tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:16.073454 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-86b5a7cc-8f83-4c6b-9a75-30a11368b52f tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:16.074615 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-86b5a7cc-8f83-4c6b-9a75-30a11368b52f tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:16.075263 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-86b5a7cc-8f83-4c6b-9a75-30a11368b52f tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:16.122349 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-86b5a7cc-8f83-4c6b-9a75-30a11368b52f tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063646 Nov 23 09:06:16.123497 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 448/895] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 23 09:06:16 2021] GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:06:16.153556 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-ed1e91a6-cc14-4480-b436-307f90896b48 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:06:16.160893 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-ed1e91a6-cc14-4480-b436-307f90896b48 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1364 microversion: 2.1 time: 0.189685 Nov 23 09:06:16.162066 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 448/896] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:06:15 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1364 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:06:16.433740 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-43deb657-587e-4c02-853d-48692922eec6 req-b50f5630-2e01-4da1-bf6e-1d8371e9d95d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b24efc8-4126-486b-92cf-3975dc60bd84", "tag": "c2e5dcf0-fb18-4cc4-9002-cb7aa635b9b7"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:16.435247 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:06:16.435247 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 09:06:16.441799 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-43deb657-587e-4c02-853d-48692922eec6 req-b50f5630-2e01-4da1-bf6e-1d8371e9d95d service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:16.442241 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-43deb657-587e-4c02-853d-48692922eec6 req-b50f5630-2e01-4da1-bf6e-1d8371e9d95d service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:16.453180 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-43deb657-587e-4c02-853d-48692922eec6 req-b50f5630-2e01-4da1-bf6e-1d8371e9d95d service nova] Creating event network-changed:c2e5dcf0-fb18-4cc4-9002-cb7aa635b9b7 for instance 0b24efc8-4126-486b-92cf-3975dc60bd84 on hv-cinder-76845 Nov 23 09:06:16.458161 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-43deb657-587e-4c02-853d-48692922eec6 req-b50f5630-2e01-4da1-bf6e-1d8371e9d95d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028062 Nov 23 09:06:16.459512 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 449/897] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:06:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:06:17.134567 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-c6562b25-8098-414a-ac6f-3e5a1c151e9d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:06:17.135645 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-c6562b25-8098-414a-ac6f-3e5a1c151e9d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:17.142293 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c6562b25-8098-414a-ac6f-3e5a1c151e9d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:17.142981 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c6562b25-8098-414a-ac6f-3e5a1c151e9d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:17.143773 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c6562b25-8098-414a-ac6f-3e5a1c151e9d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:17.144210 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c6562b25-8098-414a-ac6f-3e5a1c151e9d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:17.172945 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-c6562b25-8098-414a-ac6f-3e5a1c151e9d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042424 Nov 23 09:06:17.173537 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 449/898] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 23 09:06:17 2021] GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 09:06:17.180238 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-6294b84f-db65-4043-912e-3cd18b3bd40f tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:06:17.181281 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-6294b84f-db65-4043-912e-3cd18b3bd40f tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:17.184530 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-ca668610-20cb-4e25-996b-64d156ca58e2 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:06:17.185287 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-ca668610-20cb-4e25-996b-64d156ca58e2 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:17.188247 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6294b84f-db65-4043-912e-3cd18b3bd40f tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:17.188695 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6294b84f-db65-4043-912e-3cd18b3bd40f tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:17.189608 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6294b84f-db65-4043-912e-3cd18b3bd40f tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:17.189948 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6294b84f-db65-4043-912e-3cd18b3bd40f tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:17.191072 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ca668610-20cb-4e25-996b-64d156ca58e2 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:17.191538 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ca668610-20cb-4e25-996b-64d156ca58e2 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:17.192359 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ca668610-20cb-4e25-996b-64d156ca58e2 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:17.192768 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ca668610-20cb-4e25-996b-64d156ca58e2 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:17.285270 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.wsgi [None req-ca668610-20cb-4e25-996b-64d156ca58e2 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] HTTP exception thrown: Instance 0b24efc8-4126-486b-92cf-3975dc60bd84 is not attached to volume 968c3cd2-7658-4a92-92ef-c68773831307 Nov 23 09:06:17.285869 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-ca668610-20cb-4e25-996b-64d156ca58e2 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Returning 404 to user: Instance 0b24efc8-4126-486b-92cf-3975dc60bd84 is not attached to volume 968c3cd2-7658-4a92-92ef-c68773831307 {{(pid=116227) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 09:06:17.286728 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-ca668610-20cb-4e25-996b-64d156ca58e2 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84/os-volume_attachments/968c3cd2-7658-4a92-92ef-c68773831307" status: 404 len: 154 microversion: 2.1 time: 0.106426 Nov 23 09:06:17.288814 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 450/899] 10.222.0.46 () {58 vars in 1415 bytes} [Tue Nov 23 09:06:17 2021] DELETE /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84/os-volume_attachments/968c3cd2-7658-4a92-92ef-c68773831307 => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 09:06:17.326068 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-6294b84f-db65-4043-912e-3cd18b3bd40f tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:06:17.334616 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-6294b84f-db65-4043-912e-3cd18b3bd40f tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1364 microversion: 2.1 time: 0.158939 Nov 23 09:06:17.335681 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 450/900] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:06:17 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:06:18.352032 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-139e5d5c-6503-46de-99a7-7df8502ce111 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:06:18.352569 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-139e5d5c-6503-46de-99a7-7df8502ce111 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:18.358810 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-139e5d5c-6503-46de-99a7-7df8502ce111 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:18.359256 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-139e5d5c-6503-46de-99a7-7df8502ce111 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:18.360021 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-139e5d5c-6503-46de-99a7-7df8502ce111 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:18.360450 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-139e5d5c-6503-46de-99a7-7df8502ce111 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:18.415845 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-087b0f92-cb7d-4bdd-9cde-76732a6199ba tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:06:18.416498 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-087b0f92-cb7d-4bdd-9cde-76732a6199ba tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:18.423068 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-087b0f92-cb7d-4bdd-9cde-76732a6199ba tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:18.423517 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-087b0f92-cb7d-4bdd-9cde-76732a6199ba tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:18.424685 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-087b0f92-cb7d-4bdd-9cde-76732a6199ba tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:18.425122 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-087b0f92-cb7d-4bdd-9cde-76732a6199ba tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:18.451014 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-087b0f92-cb7d-4bdd-9cde-76732a6199ba tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Going to try to terminate instance {{(pid=116226) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 09:06:18.496506 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-139e5d5c-6503-46de-99a7-7df8502ce111 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:06:18.504434 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-139e5d5c-6503-46de-99a7-7df8502ce111 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1364 microversion: 2.1 time: 0.155939 Nov 23 09:06:18.505002 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 451/901] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:06:18 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:06:18.531407 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-087b0f92-cb7d-4bdd-9cde-76732a6199ba tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84" status: 204 len: 0 microversion: 2.1 time: 0.119590 Nov 23 09:06:18.531994 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 451/902] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 23 09:06:18 2021] DELETE /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 23 09:06:18.540602 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-2ff3aaf4-f837-4fc1-bed2-26e4b884ef54 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:06:18.541235 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-2ff3aaf4-f837-4fc1-bed2-26e4b884ef54 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:18.547021 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2ff3aaf4-f837-4fc1-bed2-26e4b884ef54 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:18.547471 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2ff3aaf4-f837-4fc1-bed2-26e4b884ef54 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:18.548246 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2ff3aaf4-f837-4fc1-bed2-26e4b884ef54 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:18.548683 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2ff3aaf4-f837-4fc1-bed2-26e4b884ef54 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:18.674565 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-2ff3aaf4-f837-4fc1-bed2-26e4b884ef54 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8695df9b3784afc8998af34694b942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d37eeef32a14dfcad683356d32556e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:06:18.682499 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-2ff3aaf4-f837-4fc1-bed2-26e4b884ef54 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84" status: 200 len: 1553 microversion: 2.1 time: 0.145638 Nov 23 09:06:18.683058 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 452/903] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:06:18 2021] GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84 => generated 1553 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:06:19.522566 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-9b203c75-4f4d-4ec2-9813-784bddf8f907 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:06:19.523257 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-9b203c75-4f4d-4ec2-9813-784bddf8f907 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:19.529524 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9b203c75-4f4d-4ec2-9813-784bddf8f907 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:19.529956 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9b203c75-4f4d-4ec2-9813-784bddf8f907 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:19.530726 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9b203c75-4f4d-4ec2-9813-784bddf8f907 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:19.531160 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9b203c75-4f4d-4ec2-9813-784bddf8f907 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:19.658446 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-9b203c75-4f4d-4ec2-9813-784bddf8f907 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:06:19.665728 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-9b203c75-4f4d-4ec2-9813-784bddf8f907 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1364 microversion: 2.1 time: 0.147779 Nov 23 09:06:19.666702 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 452/904] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:06:19 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:06:19.699901 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-bd7312ca-77d4-478b-95c9-e2e6689ac36f tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:06:19.700443 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-bd7312ca-77d4-478b-95c9-e2e6689ac36f tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:19.706633 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-bd7312ca-77d4-478b-95c9-e2e6689ac36f tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:19.707088 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-bd7312ca-77d4-478b-95c9-e2e6689ac36f tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:19.707869 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-bd7312ca-77d4-478b-95c9-e2e6689ac36f tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:19.708310 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-bd7312ca-77d4-478b-95c9-e2e6689ac36f tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:19.829199 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-bd6761cc-cf8e-4ee7-b6f3-505c7fe4b3a8 req-a0520dd7-5217-4f95-a312-f0d66498d98d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab769fa8-d310-4b1c-be00-7d2ded9d51a8", "name": "network-vif-plugged", "status": "completed", "tag": "92ef3c22-1299-429d-a178-f4715346a0f5"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:19.831016 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:06:19.831016 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 09:06:19.838940 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-bd7312ca-77d4-478b-95c9-e2e6689ac36f tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8695df9b3784afc8998af34694b942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d37eeef32a14dfcad683356d32556e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:06:19.839697 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-bd6761cc-cf8e-4ee7-b6f3-505c7fe4b3a8 req-a0520dd7-5217-4f95-a312-f0d66498d98d service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:19.840254 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-bd6761cc-cf8e-4ee7-b6f3-505c7fe4b3a8 req-a0520dd7-5217-4f95-a312-f0d66498d98d service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:19.849146 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-bd7312ca-77d4-478b-95c9-e2e6689ac36f tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84" status: 200 len: 1553 microversion: 2.1 time: 0.152687 Nov 23 09:06:19.849809 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 453/905] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:06:19 2021] GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:06:19.856453 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-bd6761cc-cf8e-4ee7-b6f3-505c7fe4b3a8 req-a0520dd7-5217-4f95-a312-f0d66498d98d service nova] Creating event network-vif-plugged:92ef3c22-1299-429d-a178-f4715346a0f5 for instance ab769fa8-d310-4b1c-be00-7d2ded9d51a8 on hv-cinder-76845 Nov 23 09:06:19.861502 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-bd6761cc-cf8e-4ee7-b6f3-505c7fe4b3a8 req-a0520dd7-5217-4f95-a312-f0d66498d98d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036246 Nov 23 09:06:19.862460 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 453/906] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:06:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 09:06:20.682667 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-6749f862-0351-4f76-9022-b9db43093d5d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:06:20.683278 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-6749f862-0351-4f76-9022-b9db43093d5d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:20.689125 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6749f862-0351-4f76-9022-b9db43093d5d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:20.689616 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6749f862-0351-4f76-9022-b9db43093d5d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:20.690400 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6749f862-0351-4f76-9022-b9db43093d5d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:20.690845 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6749f862-0351-4f76-9022-b9db43093d5d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:20.867550 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a6029adb-7d85-430c-975b-a147e76a335d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:06:20.868222 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a6029adb-7d85-430c-975b-a147e76a335d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:20.874592 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a6029adb-7d85-430c-975b-a147e76a335d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:20.875040 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a6029adb-7d85-430c-975b-a147e76a335d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:20.875886 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a6029adb-7d85-430c-975b-a147e76a335d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:20.876325 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a6029adb-7d85-430c-975b-a147e76a335d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:20.889080 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-6749f862-0351-4f76-9022-b9db43093d5d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:06:20.905858 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-6749f862-0351-4f76-9022-b9db43093d5d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1364 microversion: 2.1 time: 0.220371 Nov 23 09:06:20.915640 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 454/907] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:06:20 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1364 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:06:20.941990 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a6029adb-7d85-430c-975b-a147e76a335d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8695df9b3784afc8998af34694b942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d37eeef32a14dfcad683356d32556e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:06:20.950219 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a6029adb-7d85-430c-975b-a147e76a335d tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84" status: 200 len: 1511 microversion: 2.1 time: 0.086978 Nov 23 09:06:20.951744 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 454/908] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:06:20 2021] GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84 => generated 1511 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:06:20.985753 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-48a1f7b4-b6be-427b-92a0-97f8e35de51f req-691da1b5-8655-4114-8ff7-f129ae4c4882 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b24efc8-4126-486b-92cf-3975dc60bd84", "name": "network-vif-deleted", "tag": "c2e5dcf0-fb18-4cc4-9002-cb7aa635b9b7"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:20.987433 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:06:20.987433 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 09:06:20.995219 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-48a1f7b4-b6be-427b-92a0-97f8e35de51f req-691da1b5-8655-4114-8ff7-f129ae4c4882 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:20.995667 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-48a1f7b4-b6be-427b-92a0-97f8e35de51f req-691da1b5-8655-4114-8ff7-f129ae4c4882 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:21.007125 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-48a1f7b4-b6be-427b-92a0-97f8e35de51f req-691da1b5-8655-4114-8ff7-f129ae4c4882 service nova] Creating event network-vif-deleted:c2e5dcf0-fb18-4cc4-9002-cb7aa635b9b7 for instance 0b24efc8-4126-486b-92cf-3975dc60bd84 on hv-cinder-76845 Nov 23 09:06:21.011894 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-48a1f7b4-b6be-427b-92a0-97f8e35de51f req-691da1b5-8655-4114-8ff7-f129ae4c4882 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029815 Nov 23 09:06:21.012811 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 455/909] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:06:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:06:21.931796 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b9210201-83ca-4e1d-81a7-996366c710cc tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:06:21.932403 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b9210201-83ca-4e1d-81a7-996366c710cc tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:21.938746 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b9210201-83ca-4e1d-81a7-996366c710cc tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:21.939196 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b9210201-83ca-4e1d-81a7-996366c710cc tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:21.939979 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b9210201-83ca-4e1d-81a7-996366c710cc tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:21.940416 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b9210201-83ca-4e1d-81a7-996366c710cc tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:21.969330 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-d156d969-4d99-44bf-b517-2063b1ee3475 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:06:21.970016 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-d156d969-4d99-44bf-b517-2063b1ee3475 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] [instance: 0b24efc8-4126-486b-92cf-3975dc60bd84] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:21.976041 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d156d969-4d99-44bf-b517-2063b1ee3475 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:21.976482 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d156d969-4d99-44bf-b517-2063b1ee3475 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:21.977532 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d156d969-4d99-44bf-b517-2063b1ee3475 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:21.977993 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d156d969-4d99-44bf-b517-2063b1ee3475 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:21.992082 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.wsgi [None req-d156d969-4d99-44bf-b517-2063b1ee3475 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] HTTP exception thrown: Instance 0b24efc8-4126-486b-92cf-3975dc60bd84 could not be found. Nov 23 09:06:21.992670 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-d156d969-4d99-44bf-b517-2063b1ee3475 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Returning 404 to user: Instance 0b24efc8-4126-486b-92cf-3975dc60bd84 could not be found. {{(pid=116227) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 09:06:21.993506 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-d156d969-4d99-44bf-b517-2063b1ee3475 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84" status: 404 len: 111 microversion: 2.1 time: 0.028642 Nov 23 09:06:21.994057 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 456/910] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:06:21 2021] GET /compute/v2.1/servers/0b24efc8-4126-486b-92cf-3975dc60bd84 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 23 09:06:22.001515 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-9bc493d6-f3e5-4d31-80f1-5c26d963a571 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] Calling method '.version_select at 0x7f527ab06b80>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:06:22.019038 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-9bc493d6-f3e5-4d31-80f1-5c26d963a571 tempest-TestMinimumBasicScenario-622759696 tempest-TestMinimumBasicScenario-622759696-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-516894904" status: 202 len: 0 microversion: 2.1 time: 0.020789 Nov 23 09:06:22.019905 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 457/911] 10.222.0.46 () {58 vars in 1268 bytes} [Tue Nov 23 09:06:21 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-516894904 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 09:06:22.073514 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b9210201-83ca-4e1d-81a7-996366c710cc tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:06:22.080941 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b9210201-83ca-4e1d-81a7-996366c710cc tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1551 microversion: 2.1 time: 0.152958 Nov 23 09:06:22.081534 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 455/912] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:06:21 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1551 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:06:22.098310 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-e59bb8db-9e91-404d-878a-2a6cf14f31fe tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:06:22.098499 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-e59bb8db-9e91-404d-878a-2a6cf14f31fe tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:22.104462 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e59bb8db-9e91-404d-878a-2a6cf14f31fe tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:22.104913 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e59bb8db-9e91-404d-878a-2a6cf14f31fe tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:22.105726 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e59bb8db-9e91-404d-878a-2a6cf14f31fe tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:22.106445 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e59bb8db-9e91-404d-878a-2a6cf14f31fe tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:22.188491 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-e59bb8db-9e91-404d-878a-2a6cf14f31fe tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094434 Nov 23 09:06:22.189086 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 458/913] 10.222.0.46 () {58 vars in 1274 bytes} [Tue Nov 23 09:06:22 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:06:23.515715 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-1850fe16-187b-48fa-ab5c-54eddd7c0e1e req-a27a4634-ef1f-44eb-a4f3-5c8fa9c08888 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab769fa8-d310-4b1c-be00-7d2ded9d51a8", "tag": "92ef3c22-1299-429d-a178-f4715346a0f5"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:23.520025 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e94fc404-efce-435d-be5b-7d82dc93afd5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:23.521131 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e94fc404-efce-435d-be5b-7d82dc93afd5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:23.523802 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:06:23.523802 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 09:06:23.535096 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e94fc404-efce-435d-be5b-7d82dc93afd5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:23.535747 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e94fc404-efce-435d-be5b-7d82dc93afd5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:23.536645 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e94fc404-efce-435d-be5b-7d82dc93afd5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:23.538323 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e94fc404-efce-435d-be5b-7d82dc93afd5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:23.540469 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-1850fe16-187b-48fa-ab5c-54eddd7c0e1e req-a27a4634-ef1f-44eb-a4f3-5c8fa9c08888 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:23.546531 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-1850fe16-187b-48fa-ab5c-54eddd7c0e1e req-a27a4634-ef1f-44eb-a4f3-5c8fa9c08888 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:23.566957 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-1850fe16-187b-48fa-ab5c-54eddd7c0e1e req-a27a4634-ef1f-44eb-a4f3-5c8fa9c08888 service nova] Creating event network-changed:92ef3c22-1299-429d-a178-f4715346a0f5 for instance ab769fa8-d310-4b1c-be00-7d2ded9d51a8 on hv-cinder-76845 Nov 23 09:06:23.572585 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-1850fe16-187b-48fa-ab5c-54eddd7c0e1e req-a27a4634-ef1f-44eb-a4f3-5c8fa9c08888 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070606 Nov 23 09:06:23.575046 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 459/914] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:06:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:06:23.614550 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e94fc404-efce-435d-be5b-7d82dc93afd5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 200 len: 14 microversion: 2.1 time: 0.114275 Nov 23 09:06:23.615337 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 456/915] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:06:23 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 09:06:24.628503 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-59de943a-2732-4239-82bd-b99059515272 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:24.631564 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-59de943a-2732-4239-82bd-b99059515272 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:24.638489 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-59de943a-2732-4239-82bd-b99059515272 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:24.639193 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-59de943a-2732-4239-82bd-b99059515272 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:24.665223 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-59de943a-2732-4239-82bd-b99059515272 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:24.667199 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-59de943a-2732-4239-82bd-b99059515272 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:24.726860 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-59de943a-2732-4239-82bd-b99059515272 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 200 len: 14 microversion: 2.1 time: 0.104683 Nov 23 09:06:24.727498 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 460/916] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:06:24 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 09:06:25.737691 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c5930de9-68f2-4bcb-9f91-484c19057354 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:25.739393 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c5930de9-68f2-4bcb-9f91-484c19057354 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:25.747260 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c5930de9-68f2-4bcb-9f91-484c19057354 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:25.748156 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c5930de9-68f2-4bcb-9f91-484c19057354 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:25.748958 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c5930de9-68f2-4bcb-9f91-484c19057354 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:25.749583 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c5930de9-68f2-4bcb-9f91-484c19057354 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:25.817906 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c5930de9-68f2-4bcb-9f91-484c19057354 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 200 len: 14 microversion: 2.1 time: 0.084334 Nov 23 09:06:25.820177 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 457/917] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:06:25 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 09:06:26.830494 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-53a7b44e-652a-4aec-bf7d-68e57448850e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:26.831479 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-53a7b44e-652a-4aec-bf7d-68e57448850e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:26.838863 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-53a7b44e-652a-4aec-bf7d-68e57448850e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:26.839318 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-53a7b44e-652a-4aec-bf7d-68e57448850e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:26.840100 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-53a7b44e-652a-4aec-bf7d-68e57448850e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:26.840537 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-53a7b44e-652a-4aec-bf7d-68e57448850e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:26.898879 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-53a7b44e-652a-4aec-bf7d-68e57448850e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 200 len: 14 microversion: 2.1 time: 0.072266 Nov 23 09:06:26.902023 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 461/918] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:06:26 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 09:06:27.910464 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-867e6e24-b8ae-4390-8958-2ce796968ebd tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:27.912553 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-867e6e24-b8ae-4390-8958-2ce796968ebd tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:27.920356 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-867e6e24-b8ae-4390-8958-2ce796968ebd tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:27.920809 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-867e6e24-b8ae-4390-8958-2ce796968ebd tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:27.921859 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-867e6e24-b8ae-4390-8958-2ce796968ebd tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:27.922303 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-867e6e24-b8ae-4390-8958-2ce796968ebd tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:27.986726 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-867e6e24-b8ae-4390-8958-2ce796968ebd tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 200 len: 14 microversion: 2.1 time: 0.080212 Nov 23 09:06:27.991351 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 458/919] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:06:27 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 09:06:28.998819 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-6217f7fc-977f-4dc1-9801-e4835c07ab51 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:29.000395 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-6217f7fc-977f-4dc1-9801-e4835c07ab51 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:29.009027 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6217f7fc-977f-4dc1-9801-e4835c07ab51 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:29.009514 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6217f7fc-977f-4dc1-9801-e4835c07ab51 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:29.010321 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6217f7fc-977f-4dc1-9801-e4835c07ab51 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:29.010761 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6217f7fc-977f-4dc1-9801-e4835c07ab51 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:29.073568 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-6217f7fc-977f-4dc1-9801-e4835c07ab51 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 200 len: 14 microversion: 2.1 time: 0.078724 Nov 23 09:06:29.075167 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 462/920] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:06:28 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 09:06:30.087108 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-47d4137d-ba86-4912-8656-081e72e92c4c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:30.088307 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-47d4137d-ba86-4912-8656-081e72e92c4c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:30.096009 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-47d4137d-ba86-4912-8656-081e72e92c4c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:30.096485 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-47d4137d-ba86-4912-8656-081e72e92c4c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:30.097748 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-47d4137d-ba86-4912-8656-081e72e92c4c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:30.098220 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-47d4137d-ba86-4912-8656-081e72e92c4c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:30.154739 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-47d4137d-ba86-4912-8656-081e72e92c4c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 200 len: 14 microversion: 2.1 time: 0.072663 Nov 23 09:06:30.155367 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 459/921] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:06:30 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 09:06:31.166393 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-ae11669e-3683-4ae9-a236-d80c5c71128d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:31.167549 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-ae11669e-3683-4ae9-a236-d80c5c71128d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:31.174724 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ae11669e-3683-4ae9-a236-d80c5c71128d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:31.175178 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ae11669e-3683-4ae9-a236-d80c5c71128d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:31.175967 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ae11669e-3683-4ae9-a236-d80c5c71128d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:31.176405 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ae11669e-3683-4ae9-a236-d80c5c71128d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:31.234115 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-ae11669e-3683-4ae9-a236-d80c5c71128d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 200 len: 14 microversion: 2.1 time: 0.072639 Nov 23 09:06:31.237295 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 463/922] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:06:31 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 09:06:32.246514 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d5df66b0-fc1e-46db-9f71-eefca972e8c9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:32.247703 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d5df66b0-fc1e-46db-9f71-eefca972e8c9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:32.262529 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d5df66b0-fc1e-46db-9f71-eefca972e8c9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:32.263289 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d5df66b0-fc1e-46db-9f71-eefca972e8c9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:32.264421 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d5df66b0-fc1e-46db-9f71-eefca972e8c9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:32.265318 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d5df66b0-fc1e-46db-9f71-eefca972e8c9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:32.332563 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d5df66b0-fc1e-46db-9f71-eefca972e8c9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 200 len: 14 microversion: 2.1 time: 0.089973 Nov 23 09:06:32.336424 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 460/923] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:06:32 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 09:06:33.344468 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-9147c9a7-53d9-45fc-9cfc-5172b05317d5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:33.345641 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-9147c9a7-53d9-45fc-9cfc-5172b05317d5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:33.352761 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9147c9a7-53d9-45fc-9cfc-5172b05317d5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:33.353338 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9147c9a7-53d9-45fc-9cfc-5172b05317d5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:33.354211 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9147c9a7-53d9-45fc-9cfc-5172b05317d5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:33.354727 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9147c9a7-53d9-45fc-9cfc-5172b05317d5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:33.418014 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-9147c9a7-53d9-45fc-9cfc-5172b05317d5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 200 len: 14 microversion: 2.1 time: 0.076755 Nov 23 09:06:33.421366 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 464/924] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:06:33 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 09:06:34.432158 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-68b6a098-65ff-4ede-ac61-d39db36b6329 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:34.435848 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-68b6a098-65ff-4ede-ac61-d39db36b6329 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:34.449932 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-68b6a098-65ff-4ede-ac61-d39db36b6329 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:34.450807 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-68b6a098-65ff-4ede-ac61-d39db36b6329 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:34.451990 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-68b6a098-65ff-4ede-ac61-d39db36b6329 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:34.452653 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-68b6a098-65ff-4ede-ac61-d39db36b6329 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:34.558489 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-68b6a098-65ff-4ede-ac61-d39db36b6329 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 200 len: 11454 microversion: 2.1 time: 0.132694 Nov 23 09:06:34.559508 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 461/925] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:06:34 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 11454 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:06:35.571570 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-23f77144-c163-4eb2-942e-cbb4cd6ce0c9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:35.572915 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-23f77144-c163-4eb2-942e-cbb4cd6ce0c9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:35.580275 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-23f77144-c163-4eb2-942e-cbb4cd6ce0c9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:35.580723 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-23f77144-c163-4eb2-942e-cbb4cd6ce0c9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:35.581545 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-23f77144-c163-4eb2-942e-cbb4cd6ce0c9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:35.582002 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-23f77144-c163-4eb2-942e-cbb4cd6ce0c9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:35.658074 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-23f77144-c163-4eb2-942e-cbb4cd6ce0c9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 200 len: 18356 microversion: 2.1 time: 0.090691 Nov 23 09:06:35.660115 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 465/926] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:06:35 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 18356 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:06:36.672077 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f3149491-f214-4c97-8937-4d564a486044 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:36.673404 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f3149491-f214-4c97-8937-4d564a486044 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:36.680506 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f3149491-f214-4c97-8937-4d564a486044 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:36.681292 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f3149491-f214-4c97-8937-4d564a486044 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:36.682514 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f3149491-f214-4c97-8937-4d564a486044 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:36.683165 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f3149491-f214-4c97-8937-4d564a486044 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:36.759080 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f3149491-f214-4c97-8937-4d564a486044 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 200 len: 18871 microversion: 2.1 time: 0.092055 Nov 23 09:06:36.760909 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 462/927] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:06:36 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 18871 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:06:37.771251 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-fa271a52-134f-4e87-969c-bd925a6b3063 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:37.773379 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-fa271a52-134f-4e87-969c-bd925a6b3063 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:37.787392 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-fa271a52-134f-4e87-969c-bd925a6b3063 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:37.787854 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-fa271a52-134f-4e87-969c-bd925a6b3063 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:37.788665 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-fa271a52-134f-4e87-969c-bd925a6b3063 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:37.789353 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-fa271a52-134f-4e87-969c-bd925a6b3063 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:37.877948 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-fa271a52-134f-4e87-969c-bd925a6b3063 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 200 len: 21519 microversion: 2.1 time: 0.110358 Nov 23 09:06:37.879630 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 466/928] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:06:37 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 21519 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:06:38.891787 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-83417d2c-1ae0-4270-8793-3951fc8ff4ad tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:38.893001 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-83417d2c-1ae0-4270-8793-3951fc8ff4ad tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:38.914293 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-83417d2c-1ae0-4270-8793-3951fc8ff4ad tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:38.915012 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-83417d2c-1ae0-4270-8793-3951fc8ff4ad tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:38.916163 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-83417d2c-1ae0-4270-8793-3951fc8ff4ad tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:38.918509 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-83417d2c-1ae0-4270-8793-3951fc8ff4ad tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:39.043899 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-83417d2c-1ae0-4270-8793-3951fc8ff4ad tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 200 len: 23227 microversion: 2.1 time: 0.155950 Nov 23 09:06:39.044323 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 463/929] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:06:38 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 23227 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:06:40.054752 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-358e8743-66c4-4f95-b8d1-a6b8c7033c1d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:40.056534 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-358e8743-66c4-4f95-b8d1-a6b8c7033c1d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:40.068592 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-358e8743-66c4-4f95-b8d1-a6b8c7033c1d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:40.069869 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-358e8743-66c4-4f95-b8d1-a6b8c7033c1d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:40.071809 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-358e8743-66c4-4f95-b8d1-a6b8c7033c1d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:40.073440 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-358e8743-66c4-4f95-b8d1-a6b8c7033c1d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:40.155616 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-358e8743-66c4-4f95-b8d1-a6b8c7033c1d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 200 len: 24667 microversion: 2.1 time: 0.104986 Nov 23 09:06:40.156305 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 464/930] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:06:40 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 24667 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 09:06:40.229843 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-d4a247ea-1851-4b69-9395-9bc8af49d6e1 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Action: 'create', calling method: .version_select at 0x7f527a22bee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1101682205"}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:40.244906 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.quota [None req-d4a247ea-1851-4b69-9395-9bc8af49d6e1 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Getting quotas for project 6cac6add618145708d682ab7de8fa3af. Resources: {'key_pairs'} {{(pid=116227) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 09:06:40.249231 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.quota [None req-d4a247ea-1851-4b69-9395-9bc8af49d6e1 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Getting quotas for user 197cb8739df848a6bc9de7a90b6da99d and project 6cac6add618145708d682ab7de8fa3af. Resources: {'key_pairs'} {{(pid=116227) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 09:06:40.974597 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.quota [None req-d4a247ea-1851-4b69-9395-9bc8af49d6e1 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Getting quotas for project 6cac6add618145708d682ab7de8fa3af. Resources: {'key_pairs'} {{(pid=116227) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 09:06:40.978224 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.quota [None req-d4a247ea-1851-4b69-9395-9bc8af49d6e1 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Getting quotas for user 197cb8739df848a6bc9de7a90b6da99d and project 6cac6add618145708d682ab7de8fa3af. Resources: {'key_pairs'} {{(pid=116227) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 09:06:40.993378 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-d4a247ea-1851-4b69-9395-9bc8af49d6e1 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.958374 Nov 23 09:06:40.994123 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 467/931] 10.222.0.46 () {60 vars in 1157 bytes} [Tue Nov 23 09:06:40 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:06:41.168777 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-fb69296f-1280-475f-bea0-91aacdb8f03a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:41.169876 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-fb69296f-1280-475f-bea0-91aacdb8f03a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:41.176678 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fb69296f-1280-475f-bea0-91aacdb8f03a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:41.177230 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fb69296f-1280-475f-bea0-91aacdb8f03a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:41.178267 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fb69296f-1280-475f-bea0-91aacdb8f03a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:41.178725 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fb69296f-1280-475f-bea0-91aacdb8f03a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:41.254408 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-fb69296f-1280-475f-bea0-91aacdb8f03a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 200 len: 26206 microversion: 2.1 time: 0.090071 Nov 23 09:06:41.259639 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 465/932] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:06:41 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 26206 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 09:06:42.266650 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-f1faa6ff-ddac-4f55-b603-3bcc8c24b1aa tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:42.268248 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-f1faa6ff-ddac-4f55-b603-3bcc8c24b1aa tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:42.275092 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f1faa6ff-ddac-4f55-b603-3bcc8c24b1aa tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:42.275557 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f1faa6ff-ddac-4f55-b603-3bcc8c24b1aa tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:42.276357 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f1faa6ff-ddac-4f55-b603-3bcc8c24b1aa tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:42.276798 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f1faa6ff-ddac-4f55-b603-3bcc8c24b1aa tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:42.397959 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-f1faa6ff-ddac-4f55-b603-3bcc8c24b1aa tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 200 len: 27422 microversion: 2.1 time: 0.134883 Nov 23 09:06:42.399023 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 468/933] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:06:42 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 27422 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:06:43.412295 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-0a4bbb7c-87bf-41a4-9872-54eb9931ea8c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:43.413443 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-0a4bbb7c-87bf-41a4-9872-54eb9931ea8c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:43.420505 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0a4bbb7c-87bf-41a4-9872-54eb9931ea8c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:43.420948 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0a4bbb7c-87bf-41a4-9872-54eb9931ea8c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:43.421978 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0a4bbb7c-87bf-41a4-9872-54eb9931ea8c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:43.422417 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0a4bbb7c-87bf-41a4-9872-54eb9931ea8c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:43.511106 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-0a4bbb7c-87bf-41a4-9872-54eb9931ea8c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 200 len: 27942 microversion: 2.1 time: 0.104047 Nov 23 09:06:43.512070 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 466/934] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:06:43 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 27942 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:06:44.527023 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-0d9505c7-9752-43f5-ba86-a4488ebfa9d7 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:44.528812 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-0d9505c7-9752-43f5-ba86-a4488ebfa9d7 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:44.535766 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0d9505c7-9752-43f5-ba86-a4488ebfa9d7 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:44.536161 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0d9505c7-9752-43f5-ba86-a4488ebfa9d7 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:44.537524 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0d9505c7-9752-43f5-ba86-a4488ebfa9d7 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:44.537961 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0d9505c7-9752-43f5-ba86-a4488ebfa9d7 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:44.619494 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-0d9505c7-9752-43f5-ba86-a4488ebfa9d7 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 200 len: 28255 microversion: 2.1 time: 0.099587 Nov 23 09:06:44.620178 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 469/935] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:06:44 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 28255 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:06:45.632562 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-1c9971d1-6bc8-4738-aab8-74909ea43b39 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:45.633741 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-1c9971d1-6bc8-4738-aab8-74909ea43b39 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:45.640681 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1c9971d1-6bc8-4738-aab8-74909ea43b39 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:45.641130 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1c9971d1-6bc8-4738-aab8-74909ea43b39 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:45.641991 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1c9971d1-6bc8-4738-aab8-74909ea43b39 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:45.642676 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1c9971d1-6bc8-4738-aab8-74909ea43b39 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:45.711466 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-1c9971d1-6bc8-4738-aab8-74909ea43b39 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 200 len: 28255 microversion: 2.1 time: 0.083776 Nov 23 09:06:45.712975 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 467/936] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:06:45 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 28255 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:06:46.723141 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-4fdacd18-bd59-489f-a7aa-83e6434864ec tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:46.724859 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-4fdacd18-bd59-489f-a7aa-83e6434864ec tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:46.732491 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4fdacd18-bd59-489f-a7aa-83e6434864ec tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:46.732947 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4fdacd18-bd59-489f-a7aa-83e6434864ec tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:46.733881 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4fdacd18-bd59-489f-a7aa-83e6434864ec tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:46.734323 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4fdacd18-bd59-489f-a7aa-83e6434864ec tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:46.811093 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-4fdacd18-bd59-489f-a7aa-83e6434864ec tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 200 len: 28546 microversion: 2.1 time: 0.091815 Nov 23 09:06:46.811755 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 470/937] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:06:46 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 28546 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:06:47.823132 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-2d6c63cb-5185-4791-b131-54865b5270ee tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:47.824120 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-2d6c63cb-5185-4791-b131-54865b5270ee tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:47.831684 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2d6c63cb-5185-4791-b131-54865b5270ee tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:47.832135 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2d6c63cb-5185-4791-b131-54865b5270ee tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:47.833359 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2d6c63cb-5185-4791-b131-54865b5270ee tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:47.833798 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2d6c63cb-5185-4791-b131-54865b5270ee tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:47.908970 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-2d6c63cb-5185-4791-b131-54865b5270ee tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 200 len: 28714 microversion: 2.1 time: 0.089604 Nov 23 09:06:47.909656 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 468/938] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:06:47 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 28714 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 09:06:48.921672 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-f76cf2b7-d2c3-49cd-b4b9-d523d36d5bad tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:48.922579 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-f76cf2b7-d2c3-49cd-b4b9-d523d36d5bad tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:48.930274 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f76cf2b7-d2c3-49cd-b4b9-d523d36d5bad tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:48.930736 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f76cf2b7-d2c3-49cd-b4b9-d523d36d5bad tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:48.931525 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f76cf2b7-d2c3-49cd-b4b9-d523d36d5bad tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:48.931965 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f76cf2b7-d2c3-49cd-b4b9-d523d36d5bad tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:48.995783 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-f76cf2b7-d2c3-49cd-b4b9-d523d36d5bad tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 200 len: 28714 microversion: 2.1 time: 0.078084 Nov 23 09:06:48.996468 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 471/939] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:06:48 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 28714 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:06:50.008225 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d2295e54-9249-4e05-9044-4b9342b4e623 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:50.009250 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d2295e54-9249-4e05-9044-4b9342b4e623 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:50.016419 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d2295e54-9249-4e05-9044-4b9342b4e623 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:50.017026 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d2295e54-9249-4e05-9044-4b9342b4e623 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:50.017893 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d2295e54-9249-4e05-9044-4b9342b4e623 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:50.018379 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d2295e54-9249-4e05-9044-4b9342b4e623 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:50.089822 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d2295e54-9249-4e05-9044-4b9342b4e623 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 200 len: 28714 microversion: 2.1 time: 0.085502 Nov 23 09:06:50.090767 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 469/940] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:06:50 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 28714 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 09:06:51.103163 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-21225ee5-16e7-4bfa-992e-ad71b11f11ac tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:51.104190 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-21225ee5-16e7-4bfa-992e-ad71b11f11ac tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:51.111067 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-21225ee5-16e7-4bfa-992e-ad71b11f11ac tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:51.111524 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-21225ee5-16e7-4bfa-992e-ad71b11f11ac tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:51.112328 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-21225ee5-16e7-4bfa-992e-ad71b11f11ac tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:51.112773 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-21225ee5-16e7-4bfa-992e-ad71b11f11ac tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:51.176823 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-21225ee5-16e7-4bfa-992e-ad71b11f11ac tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 200 len: 28714 microversion: 2.1 time: 0.077946 Nov 23 09:06:51.177536 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 472/941] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:06:51 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 28714 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:06:52.190256 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-cd241864-4cc8-469d-8c6b-332063290b6b tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:52.191272 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-cd241864-4cc8-469d-8c6b-332063290b6b tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:52.198719 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cd241864-4cc8-469d-8c6b-332063290b6b tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:52.199172 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cd241864-4cc8-469d-8c6b-332063290b6b tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:52.199985 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cd241864-4cc8-469d-8c6b-332063290b6b tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:52.200460 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cd241864-4cc8-469d-8c6b-332063290b6b tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:52.277933 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-cd241864-4cc8-469d-8c6b-332063290b6b tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 200 len: 29322 microversion: 2.1 time: 0.091577 Nov 23 09:06:52.278593 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 470/942] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:06:52 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 29322 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:06:53.291154 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-0ebc085b-ae88-48b9-a747-eeb1c09c853d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:53.292140 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-0ebc085b-ae88-48b9-a747-eeb1c09c853d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:53.299754 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0ebc085b-ae88-48b9-a747-eeb1c09c853d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:53.300201 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0ebc085b-ae88-48b9-a747-eeb1c09c853d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:53.300983 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0ebc085b-ae88-48b9-a747-eeb1c09c853d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:53.301449 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0ebc085b-ae88-48b9-a747-eeb1c09c853d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:53.375222 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-0ebc085b-ae88-48b9-a747-eeb1c09c853d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 200 len: 31023 microversion: 2.1 time: 0.088532 Nov 23 09:06:53.375793 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 473/943] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:06:53 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 31023 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:06:54.387168 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-466ffd66-4d3d-49e6-94b9-7d00a570b2b5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:54.388172 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-466ffd66-4d3d-49e6-94b9-7d00a570b2b5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:54.395045 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-466ffd66-4d3d-49e6-94b9-7d00a570b2b5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:54.395493 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-466ffd66-4d3d-49e6-94b9-7d00a570b2b5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:54.396267 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-466ffd66-4d3d-49e6-94b9-7d00a570b2b5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:54.396701 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-466ffd66-4d3d-49e6-94b9-7d00a570b2b5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:54.471285 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-466ffd66-4d3d-49e6-94b9-7d00a570b2b5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 200 len: 32557 microversion: 2.1 time: 0.087977 Nov 23 09:06:54.471938 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 471/944] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:06:54 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 32557 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:06:55.483609 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-7ab3beb0-95e9-454c-84bd-c10bb8a8e900 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:55.484786 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-7ab3beb0-95e9-454c-84bd-c10bb8a8e900 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:55.493292 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7ab3beb0-95e9-454c-84bd-c10bb8a8e900 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:55.493755 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7ab3beb0-95e9-454c-84bd-c10bb8a8e900 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:55.494546 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7ab3beb0-95e9-454c-84bd-c10bb8a8e900 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:55.494994 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7ab3beb0-95e9-454c-84bd-c10bb8a8e900 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:55.576015 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-7ab3beb0-95e9-454c-84bd-c10bb8a8e900 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 200 len: 33449 microversion: 2.1 time: 0.096557 Nov 23 09:06:55.576646 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 474/945] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:06:55 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 33449 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:06:56.588732 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-0ab37fce-507f-49ba-bfa9-e8c768674305 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:56.589819 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-0ab37fce-507f-49ba-bfa9-e8c768674305 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:56.596585 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ab37fce-507f-49ba-bfa9-e8c768674305 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:56.597039 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ab37fce-507f-49ba-bfa9-e8c768674305 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:56.597844 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ab37fce-507f-49ba-bfa9-e8c768674305 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:56.598280 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ab37fce-507f-49ba-bfa9-e8c768674305 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:56.676516 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-0ab37fce-507f-49ba-bfa9-e8c768674305 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 200 len: 34112 microversion: 2.1 time: 0.091784 Nov 23 09:06:56.677116 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 472/946] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:06:56 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 34112 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:06:57.688596 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-d360e66c-f4a4-4a8f-89f8-163759c024f5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:57.689651 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-d360e66c-f4a4-4a8f-89f8-163759c024f5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:57.696946 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d360e66c-f4a4-4a8f-89f8-163759c024f5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:57.697430 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d360e66c-f4a4-4a8f-89f8-163759c024f5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:57.698209 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d360e66c-f4a4-4a8f-89f8-163759c024f5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:57.698647 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d360e66c-f4a4-4a8f-89f8-163759c024f5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:57.767207 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-d360e66c-f4a4-4a8f-89f8-163759c024f5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 200 len: 35253 microversion: 2.1 time: 0.082466 Nov 23 09:06:57.768093 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 475/947] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:06:57 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 35253 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:06:58.099551 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-bd1259a4-89b7-4bed-abe8-2da4c7299e76 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1174270501", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1101682205", "security_groups": [{"name": "tempest-secgroup-smoke-1101689327"}], "networks": [{"uuid": "394a2a58-dcca-4518-9053-d6b7a3085c18"}], "block_device_mapping_v2": [{"uuid": "0998058a-03ca-4430-adfb-4159281e8bdb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:58.209428 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.network.neutron [None req-bd1259a4-89b7-4bed-abe8-2da4c7299e76 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] validate_networks() for [('394a2a58-dcca-4518-9053-d6b7a3085c18', None, None, None, None, None)] {{(pid=116226) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 09:06:58.563066 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-bd1259a4-89b7-4bed-abe8-2da4c7299e76 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Flavor limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 09:06:58.563493 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-bd1259a4-89b7-4bed-abe8-2da4c7299e76 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Image limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 09:06:58.564001 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-bd1259a4-89b7-4bed-abe8-2da4c7299e76 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Flavor pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 09:06:58.564440 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-bd1259a4-89b7-4bed-abe8-2da4c7299e76 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Image pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 09:06:58.564851 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-bd1259a4-89b7-4bed-abe8-2da4c7299e76 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 09:06:58.573907 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bd1259a4-89b7-4bed-abe8-2da4c7299e76 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:58.574356 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bd1259a4-89b7-4bed-abe8-2da4c7299e76 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:58.575174 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bd1259a4-89b7-4bed-abe8-2da4c7299e76 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:58.575611 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bd1259a4-89b7-4bed-abe8-2da4c7299e76 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:58.592008 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-bd1259a4-89b7-4bed-abe8-2da4c7299e76 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Getting quotas for project 6cac6add618145708d682ab7de8fa3af. Resources: {'instances', 'ram', 'cores'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 09:06:58.595905 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-bd1259a4-89b7-4bed-abe8-2da4c7299e76 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Getting quotas for user 197cb8739df848a6bc9de7a90b6da99d and project 6cac6add618145708d682ab7de8fa3af. Resources: {'instances', 'ram', 'cores'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 09:06:58.650772 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-bd1259a4-89b7-4bed-abe8-2da4c7299e76 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Going to run 1 instances... {{(pid=116226) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 09:06:58.652969 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-bd1259a4-89b7-4bed-abe8-2da4c7299e76 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0998058a-03ca-4430-adfb-4159281e8bdb',volume_size=None,volume_type=None)] {{(pid=116226) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 09:06:58.770639 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-bd1259a4-89b7-4bed-abe8-2da4c7299e76 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.675056 Nov 23 09:06:58.771271 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 473/948] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 23 09:06:58 2021] POST /compute/v2.1/servers => generated 406 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 09:06:58.779740 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-995342a8-c7c7-409a-8bef-8dc03b739d79 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:58.780748 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-995342a8-c7c7-409a-8bef-8dc03b739d79 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:58.782018 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-9d2c3887-7048-4452-83da-c9fffcc0a4ed tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:06:58.782804 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-9d2c3887-7048-4452-83da-c9fffcc0a4ed tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:58.787726 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-995342a8-c7c7-409a-8bef-8dc03b739d79 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:58.789518 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-995342a8-c7c7-409a-8bef-8dc03b739d79 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:58.791598 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-995342a8-c7c7-409a-8bef-8dc03b739d79 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:58.792422 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-995342a8-c7c7-409a-8bef-8dc03b739d79 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:58.835662 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-9d2c3887-7048-4452-83da-c9fffcc0a4ed tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197cb8739df848a6bc9de7a90b6da99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac6add618145708d682ab7de8fa3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:06:58.842996 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-9d2c3887-7048-4452-83da-c9fffcc0a4ed tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 200 len: 1089 microversion: 2.1 time: 0.064632 Nov 23 09:06:58.843561 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 474/949] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:06:58 2021] GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 1089 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:06:58.868733 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-995342a8-c7c7-409a-8bef-8dc03b739d79 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 200 len: 36743 microversion: 2.1 time: 0.092807 Nov 23 09:06:58.869419 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 476/950] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:06:58 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 36743 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:06:59.859619 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f33aaf88-52ce-4bde-b87d-57a6b3c1b132 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:06:59.860341 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f33aaf88-52ce-4bde-b87d-57a6b3c1b132 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:59.866976 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f33aaf88-52ce-4bde-b87d-57a6b3c1b132 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:59.869269 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f33aaf88-52ce-4bde-b87d-57a6b3c1b132 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:59.870170 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f33aaf88-52ce-4bde-b87d-57a6b3c1b132 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:59.870611 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f33aaf88-52ce-4bde-b87d-57a6b3c1b132 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:59.881397 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-526620f8-96ea-44d0-8a15-edd0cb383515 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:06:59.882532 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-526620f8-96ea-44d0-8a15-edd0cb383515 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:06:59.891660 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-526620f8-96ea-44d0-8a15-edd0cb383515 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:59.892113 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-526620f8-96ea-44d0-8a15-edd0cb383515 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:59.893138 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-526620f8-96ea-44d0-8a15-edd0cb383515 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:06:59.893616 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-526620f8-96ea-44d0-8a15-edd0cb383515 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:06:59.932731 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-f33aaf88-52ce-4bde-b87d-57a6b3c1b132 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197cb8739df848a6bc9de7a90b6da99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac6add618145708d682ab7de8fa3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:06:59.942509 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f33aaf88-52ce-4bde-b87d-57a6b3c1b132 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 200 len: 1205 microversion: 2.1 time: 0.086354 Nov 23 09:06:59.943399 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 475/951] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:06:59 2021] GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 1205 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:06:59.967394 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-526620f8-96ea-44d0-8a15-edd0cb383515 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 200 len: 38198 microversion: 2.1 time: 0.089827 Nov 23 09:06:59.968280 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 477/952] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:06:59 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 38198 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 09:07:00.960988 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d656e336-9f04-4501-b920-ae803099824e tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:00.961978 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d656e336-9f04-4501-b920-ae803099824e tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:00.967814 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d656e336-9f04-4501-b920-ae803099824e tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:00.968272 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d656e336-9f04-4501-b920-ae803099824e tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:00.969046 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d656e336-9f04-4501-b920-ae803099824e tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:00.969511 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d656e336-9f04-4501-b920-ae803099824e tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:00.981016 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-e6d0dc44-6c68-4d9e-8636-d13a5b88d3df tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:07:00.985863 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-e6d0dc44-6c68-4d9e-8636-d13a5b88d3df tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:00.998503 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e6d0dc44-6c68-4d9e-8636-d13a5b88d3df tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:00.999149 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e6d0dc44-6c68-4d9e-8636-d13a5b88d3df tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:01.000316 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e6d0dc44-6c68-4d9e-8636-d13a5b88d3df tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:01.004362 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e6d0dc44-6c68-4d9e-8636-d13a5b88d3df tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:01.089360 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-e6d0dc44-6c68-4d9e-8636-d13a5b88d3df tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 200 len: 38236 microversion: 2.1 time: 0.110487 Nov 23 09:07:01.095170 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 478/953] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:07:00 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 38236 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 09:07:01.101523 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-0e5139d9-9b95-40f5-bc4c-8962fd4ae474 req-45c603c8-7cbc-475a-a6f2-f9ef02e2d751 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06366ba9-6cab-4a74-97b6-d256cd9bd6d1", "tag": "4f3fac16-b08e-4467-807a-ffaf42239b72"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:07:01.103662 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:07:01.103662 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 09:07:01.111356 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-0e5139d9-9b95-40f5-bc4c-8962fd4ae474 req-45c603c8-7cbc-475a-a6f2-f9ef02e2d751 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:01.113061 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-0e5139d9-9b95-40f5-bc4c-8962fd4ae474 req-45c603c8-7cbc-475a-a6f2-f9ef02e2d751 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:01.125911 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-0e5139d9-9b95-40f5-bc4c-8962fd4ae474 req-45c603c8-7cbc-475a-a6f2-f9ef02e2d751 service nova] Creating event network-changed:4f3fac16-b08e-4467-807a-ffaf42239b72 for instance 06366ba9-6cab-4a74-97b6-d256cd9bd6d1 on hv-cinder-76845 Nov 23 09:07:01.131245 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-0e5139d9-9b95-40f5-bc4c-8962fd4ae474 req-45c603c8-7cbc-475a-a6f2-f9ef02e2d751 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034199 Nov 23 09:07:01.132141 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 479/954] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:07:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:07:01.145108 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d656e336-9f04-4501-b920-ae803099824e tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197cb8739df848a6bc9de7a90b6da99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac6add618145708d682ab7de8fa3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:01.154115 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d656e336-9f04-4501-b920-ae803099824e tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 200 len: 1261 microversion: 2.1 time: 0.197026 Nov 23 09:07:01.154705 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 476/955] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:00 2021] GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 1261 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:07:02.104744 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-a457a65c-99cb-471b-841c-f6cd31f26c4d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:07:02.105826 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-a457a65c-99cb-471b-841c-f6cd31f26c4d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:02.112239 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a457a65c-99cb-471b-841c-f6cd31f26c4d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:02.112683 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a457a65c-99cb-471b-841c-f6cd31f26c4d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:02.113477 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a457a65c-99cb-471b-841c-f6cd31f26c4d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:02.113913 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a457a65c-99cb-471b-841c-f6cd31f26c4d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:02.171485 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-956e1326-4e04-4feb-84e6-c00cd96ff2f2 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:02.172127 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-956e1326-4e04-4feb-84e6-c00cd96ff2f2 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:02.178348 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-956e1326-4e04-4feb-84e6-c00cd96ff2f2 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:02.178802 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-956e1326-4e04-4feb-84e6-c00cd96ff2f2 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:02.179576 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-956e1326-4e04-4feb-84e6-c00cd96ff2f2 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:02.180015 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-956e1326-4e04-4feb-84e6-c00cd96ff2f2 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:02.311235 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-956e1326-4e04-4feb-84e6-c00cd96ff2f2 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197cb8739df848a6bc9de7a90b6da99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac6add618145708d682ab7de8fa3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:02.318387 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-956e1326-4e04-4feb-84e6-c00cd96ff2f2 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 200 len: 1261 microversion: 2.1 time: 0.150697 Nov 23 09:07:02.318958 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 477/956] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:02 2021] GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:07:03.335140 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-0da1ebf6-f250-417c-a677-e6c954b76e61 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:03.335811 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-0da1ebf6-f250-417c-a677-e6c954b76e61 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:03.342033 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0da1ebf6-f250-417c-a677-e6c954b76e61 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:03.342514 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0da1ebf6-f250-417c-a677-e6c954b76e61 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:03.343294 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0da1ebf6-f250-417c-a677-e6c954b76e61 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:03.343727 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0da1ebf6-f250-417c-a677-e6c954b76e61 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:03.470809 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-0da1ebf6-f250-417c-a677-e6c954b76e61 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197cb8739df848a6bc9de7a90b6da99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac6add618145708d682ab7de8fa3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:03.478655 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-0da1ebf6-f250-417c-a677-e6c954b76e61 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 200 len: 1261 microversion: 2.1 time: 0.147416 Nov 23 09:07:03.479226 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 478/957] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:03 2021] GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 1261 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:07:04.495841 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f3c6011b-03b9-47ad-b0af-200d27dc8dcc tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:04.496514 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f3c6011b-03b9-47ad-b0af-200d27dc8dcc tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:04.502510 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f3c6011b-03b9-47ad-b0af-200d27dc8dcc tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:04.502953 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f3c6011b-03b9-47ad-b0af-200d27dc8dcc tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:04.503716 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f3c6011b-03b9-47ad-b0af-200d27dc8dcc tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:04.504145 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f3c6011b-03b9-47ad-b0af-200d27dc8dcc tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:04.638889 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-f3c6011b-03b9-47ad-b0af-200d27dc8dcc tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197cb8739df848a6bc9de7a90b6da99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac6add618145708d682ab7de8fa3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:04.643097 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-a457a65c-99cb-471b-841c-f6cd31f26c4d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 200 len: 38236 microversion: 2.1 time: 2.542808 Nov 23 09:07:04.644307 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 480/958] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:07:02 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 38236 bytes in 2545 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:07:04.646381 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f3c6011b-03b9-47ad-b0af-200d27dc8dcc tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 200 len: 1261 microversion: 2.1 time: 0.154784 Nov 23 09:07:04.646944 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 479/959] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:04 2021] GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:07:05.655339 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-b53f5472-a369-46ac-80e4-1eac4fd01cdd tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:07:05.656326 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-b53f5472-a369-46ac-80e4-1eac4fd01cdd tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:05.663716 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d333cf44-8b3d-4c87-9560-3296c7cdebf6 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:05.664328 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d333cf44-8b3d-4c87-9560-3296c7cdebf6 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:05.666061 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b53f5472-a369-46ac-80e4-1eac4fd01cdd tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:05.666510 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b53f5472-a369-46ac-80e4-1eac4fd01cdd tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:05.667290 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b53f5472-a369-46ac-80e4-1eac4fd01cdd tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:05.667722 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b53f5472-a369-46ac-80e4-1eac4fd01cdd tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:05.671263 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d333cf44-8b3d-4c87-9560-3296c7cdebf6 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:05.671721 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d333cf44-8b3d-4c87-9560-3296c7cdebf6 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:05.672504 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d333cf44-8b3d-4c87-9560-3296c7cdebf6 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:05.672943 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d333cf44-8b3d-4c87-9560-3296c7cdebf6 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:05.741576 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-b53f5472-a369-46ac-80e4-1eac4fd01cdd tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 200 len: 38246 microversion: 2.1 time: 0.090021 Nov 23 09:07:05.742363 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 481/960] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:07:05 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 38246 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:07:05.804858 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d333cf44-8b3d-4c87-9560-3296c7cdebf6 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197cb8739df848a6bc9de7a90b6da99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac6add618145708d682ab7de8fa3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:05.812779 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d333cf44-8b3d-4c87-9560-3296c7cdebf6 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 200 len: 1261 microversion: 2.1 time: 0.152659 Nov 23 09:07:05.813395 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 480/961] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:05 2021] GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:07:06.754794 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-17532d43-caf2-4b93-87a2-30c1d80b9cee tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:07:06.755792 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-17532d43-caf2-4b93-87a2-30c1d80b9cee tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:06.763134 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-17532d43-caf2-4b93-87a2-30c1d80b9cee tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:06.763595 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-17532d43-caf2-4b93-87a2-30c1d80b9cee tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:06.764387 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-17532d43-caf2-4b93-87a2-30c1d80b9cee tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:06.764828 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-17532d43-caf2-4b93-87a2-30c1d80b9cee tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:06.829359 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-6f5addac-73ae-44cd-a5bc-fda804cd2868 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:06.829964 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-6f5addac-73ae-44cd-a5bc-fda804cd2868 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:06.836488 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6f5addac-73ae-44cd-a5bc-fda804cd2868 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:06.836937 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6f5addac-73ae-44cd-a5bc-fda804cd2868 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:06.838745 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6f5addac-73ae-44cd-a5bc-fda804cd2868 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:06.839200 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6f5addac-73ae-44cd-a5bc-fda804cd2868 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:06.843404 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-17532d43-caf2-4b93-87a2-30c1d80b9cee tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 200 len: 38367 microversion: 2.1 time: 0.092509 Nov 23 09:07:06.848847 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 482/962] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:07:06 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 38367 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 09:07:06.855302 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-db21e113-c905-45f9-9ab4-682361209581 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:06.855870 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-db21e113-c905-45f9-9ab4-682361209581 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:06.862616 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-db21e113-c905-45f9-9ab4-682361209581 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:06.863064 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-db21e113-c905-45f9-9ab4-682361209581 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:06.863838 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-db21e113-c905-45f9-9ab4-682361209581 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:06.864406 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-db21e113-c905-45f9-9ab4-682361209581 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:06.888825 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-db21e113-c905-45f9-9ab4-682361209581 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/ips" status: 200 len: 147 microversion: 2.1 time: 0.038517 Nov 23 09:07:06.889571 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 483/963] 10.222.0.46 () {58 vars in 1247 bytes} [Tue Nov 23 09:07:06 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/ips => generated 147 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:07:06.983213 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-6f5addac-73ae-44cd-a5bc-fda804cd2868 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197cb8739df848a6bc9de7a90b6da99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac6add618145708d682ab7de8fa3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:06.990390 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-6f5addac-73ae-44cd-a5bc-fda804cd2868 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 200 len: 1261 microversion: 2.1 time: 0.164679 Nov 23 09:07:06.990957 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 481/964] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:06 2021] GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:07:08.008590 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-901be13a-5a64-4bdc-abe4-16405e519e44 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:08.009614 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-901be13a-5a64-4bdc-abe4-16405e519e44 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:08.016504 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-901be13a-5a64-4bdc-abe4-16405e519e44 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:08.016958 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-901be13a-5a64-4bdc-abe4-16405e519e44 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:08.017766 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-901be13a-5a64-4bdc-abe4-16405e519e44 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:08.018201 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-901be13a-5a64-4bdc-abe4-16405e519e44 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:08.155227 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-901be13a-5a64-4bdc-abe4-16405e519e44 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197cb8739df848a6bc9de7a90b6da99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac6add618145708d682ab7de8fa3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:08.162483 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-901be13a-5a64-4bdc-abe4-16405e519e44 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 200 len: 1261 microversion: 2.1 time: 0.158971 Nov 23 09:07:08.163032 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 484/965] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:08 2021] GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:07:08.311517 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e796d582-5551-4220-ad98-93c276eb8b57 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-838523098", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1835873804", "security_groups": [{"name": "tempest-secgroup-smoke-474799054"}], "block_device_mapping_v2": [{"uuid": "ba91984d-2300-4384-8c5d-94aa97323f3e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d2703dbd-849e-45eb-9768-17f699057b49"}]}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:07:08.428360 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.network.neutron [None req-e796d582-5551-4220-ad98-93c276eb8b57 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] validate_networks() for [('d2703dbd-849e-45eb-9768-17f699057b49', None, None, None, None, None)] {{(pid=116226) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 09:07:08.797483 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-e796d582-5551-4220-ad98-93c276eb8b57 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Flavor limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 09:07:08.797900 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-e796d582-5551-4220-ad98-93c276eb8b57 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Image limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 09:07:08.798366 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-e796d582-5551-4220-ad98-93c276eb8b57 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Flavor pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 09:07:08.798768 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-e796d582-5551-4220-ad98-93c276eb8b57 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Image pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 09:07:08.799171 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-e796d582-5551-4220-ad98-93c276eb8b57 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 09:07:08.808024 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e796d582-5551-4220-ad98-93c276eb8b57 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:08.808466 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e796d582-5551-4220-ad98-93c276eb8b57 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:08.809312 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e796d582-5551-4220-ad98-93c276eb8b57 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:08.809747 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e796d582-5551-4220-ad98-93c276eb8b57 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:08.826133 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-e796d582-5551-4220-ad98-93c276eb8b57 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Getting quotas for project 229671159ee9412ca1bcc93a838c73c1. Resources: {'instances', 'ram', 'cores'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 09:07:08.829724 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-e796d582-5551-4220-ad98-93c276eb8b57 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Getting quotas for user 8e26aa2383ab4e5da1bdc6712f58af06 and project 229671159ee9412ca1bcc93a838c73c1. Resources: {'instances', 'ram', 'cores'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 09:07:08.883027 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e796d582-5551-4220-ad98-93c276eb8b57 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Going to run 1 instances... {{(pid=116226) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 09:07:08.885890 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e796d582-5551-4220-ad98-93c276eb8b57 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 83736d76-590f-4b9d-9044-f31d4620cec6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ba91984d-2300-4384-8c5d-94aa97323f3e',volume_size=None,volume_type=None)] {{(pid=116226) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 09:07:09.006162 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e796d582-5551-4220-ad98-93c276eb8b57 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.698714 Nov 23 09:07:09.006805 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 482/966] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 23 09:07:08 2021] POST /compute/v2.1/servers => generated 405 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 23 09:07:09.017372 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-b086b3d8-ba35-4cbf-a463-f2e317b95aba tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:09.018003 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-b086b3d8-ba35-4cbf-a463-f2e317b95aba tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 83736d76-590f-4b9d-9044-f31d4620cec6] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:09.067814 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-b086b3d8-ba35-4cbf-a463-f2e317b95aba tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:09.075133 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-b086b3d8-ba35-4cbf-a463-f2e317b95aba tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6" status: 200 len: 1094 microversion: 2.1 time: 0.061337 Nov 23 09:07:09.075712 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 485/967] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:09 2021] GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6 => generated 1094 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:07:09.179647 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-95b1aee2-d8f3-4dd5-b142-aba5ef0efee6 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:09.180337 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-95b1aee2-d8f3-4dd5-b142-aba5ef0efee6 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:09.187781 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-95b1aee2-d8f3-4dd5-b142-aba5ef0efee6 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:09.188300 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-95b1aee2-d8f3-4dd5-b142-aba5ef0efee6 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:09.189427 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-95b1aee2-d8f3-4dd5-b142-aba5ef0efee6 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:09.189866 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-95b1aee2-d8f3-4dd5-b142-aba5ef0efee6 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:09.327704 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-95b1aee2-d8f3-4dd5-b142-aba5ef0efee6 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197cb8739df848a6bc9de7a90b6da99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac6add618145708d682ab7de8fa3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:09.335250 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-95b1aee2-d8f3-4dd5-b142-aba5ef0efee6 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 200 len: 1261 microversion: 2.1 time: 0.159302 Nov 23 09:07:09.335825 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 483/968] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:09 2021] GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:07:09.465341 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-22dd5579-8d42-4adf-bdaa-312b6ff11eac tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "770079c3-b467-47ee-bf60-663afc85fa98"}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:07:09.466524 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-22dd5579-8d42-4adf-bdaa-312b6ff11eac tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:09.473426 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-22dd5579-8d42-4adf-bdaa-312b6ff11eac tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:09.473872 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-22dd5579-8d42-4adf-bdaa-312b6ff11eac tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:09.474683 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-22dd5579-8d42-4adf-bdaa-312b6ff11eac tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:09.475125 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-22dd5579-8d42-4adf-bdaa-312b6ff11eac tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:09.714773 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-22dd5579-8d42-4adf-bdaa-312b6ff11eac tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253075 Nov 23 09:07:09.715389 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 486/969] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 23 09:07:09 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:07:10.092983 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-15a1551a-8a90-4140-bea0-37dcb9e2c689 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:10.093632 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-15a1551a-8a90-4140-bea0-37dcb9e2c689 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 83736d76-590f-4b9d-9044-f31d4620cec6] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:10.101856 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-15a1551a-8a90-4140-bea0-37dcb9e2c689 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:10.102418 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-15a1551a-8a90-4140-bea0-37dcb9e2c689 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:10.103181 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-15a1551a-8a90-4140-bea0-37dcb9e2c689 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:10.103624 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-15a1551a-8a90-4140-bea0-37dcb9e2c689 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:10.173709 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-15a1551a-8a90-4140-bea0-37dcb9e2c689 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:10.181589 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-15a1551a-8a90-4140-bea0-37dcb9e2c689 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6" status: 200 len: 1210 microversion: 2.1 time: 0.092488 Nov 23 09:07:10.182249 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 484/970] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:10 2021] GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6 => generated 1210 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:07:10.354698 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-2fcdea71-de1f-4447-bb6b-2b70dd2f7293 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:10.355414 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-2fcdea71-de1f-4447-bb6b-2b70dd2f7293 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:10.362912 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2fcdea71-de1f-4447-bb6b-2b70dd2f7293 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:10.363377 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2fcdea71-de1f-4447-bb6b-2b70dd2f7293 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:10.364178 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2fcdea71-de1f-4447-bb6b-2b70dd2f7293 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:10.364627 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2fcdea71-de1f-4447-bb6b-2b70dd2f7293 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:10.591532 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-2fcdea71-de1f-4447-bb6b-2b70dd2f7293 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197cb8739df848a6bc9de7a90b6da99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac6add618145708d682ab7de8fa3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:10.599060 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-2fcdea71-de1f-4447-bb6b-2b70dd2f7293 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 200 len: 1261 microversion: 2.1 time: 0.250593 Nov 23 09:07:10.599637 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 487/971] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:10 2021] GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 1261 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:07:11.199313 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-fd4848fc-4db2-4198-87a1-9a3039d7c22b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:11.200625 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-fd4848fc-4db2-4198-87a1-9a3039d7c22b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 83736d76-590f-4b9d-9044-f31d4620cec6] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:11.207571 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fd4848fc-4db2-4198-87a1-9a3039d7c22b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:11.208015 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fd4848fc-4db2-4198-87a1-9a3039d7c22b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:11.208986 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fd4848fc-4db2-4198-87a1-9a3039d7c22b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:11.209613 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fd4848fc-4db2-4198-87a1-9a3039d7c22b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:11.349971 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-fd4848fc-4db2-4198-87a1-9a3039d7c22b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:11.358812 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-fd4848fc-4db2-4198-87a1-9a3039d7c22b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6" status: 200 len: 1277 microversion: 2.1 time: 0.163547 Nov 23 09:07:11.360102 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 485/972] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:11 2021] GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6 => generated 1277 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:07:11.369121 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-1a04faef-05fc-449f-874d-c498ecf914c4 req-ddfca1ff-c33b-4d04-b026-b4eaba96c7d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83736d76-590f-4b9d-9044-f31d4620cec6", "tag": "8040e5ea-5091-448c-af26-6c32aed63601"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:07:11.373784 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:07:11.373784 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 09:07:11.383022 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-1a04faef-05fc-449f-874d-c498ecf914c4 req-ddfca1ff-c33b-4d04-b026-b4eaba96c7d7 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:11.383565 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-1a04faef-05fc-449f-874d-c498ecf914c4 req-ddfca1ff-c33b-4d04-b026-b4eaba96c7d7 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:11.407303 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-1a04faef-05fc-449f-874d-c498ecf914c4 req-ddfca1ff-c33b-4d04-b026-b4eaba96c7d7 service nova] Creating event network-changed:8040e5ea-5091-448c-af26-6c32aed63601 for instance 83736d76-590f-4b9d-9044-f31d4620cec6 on hv-cinder-76845 Nov 23 09:07:11.412471 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-1a04faef-05fc-449f-874d-c498ecf914c4 req-ddfca1ff-c33b-4d04-b026-b4eaba96c7d7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047537 Nov 23 09:07:11.413362 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 488/973] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:07:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:07:11.616644 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-63c30a4a-983a-4bc4-95c1-587049ded700 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:11.617320 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-63c30a4a-983a-4bc4-95c1-587049ded700 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:11.624159 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-63c30a4a-983a-4bc4-95c1-587049ded700 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:11.624808 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-63c30a4a-983a-4bc4-95c1-587049ded700 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:11.625628 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-63c30a4a-983a-4bc4-95c1-587049ded700 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:11.626250 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-63c30a4a-983a-4bc4-95c1-587049ded700 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:11.758983 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-63c30a4a-983a-4bc4-95c1-587049ded700 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197cb8739df848a6bc9de7a90b6da99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac6add618145708d682ab7de8fa3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:11.766893 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-63c30a4a-983a-4bc4-95c1-587049ded700 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 200 len: 1261 microversion: 2.1 time: 0.154170 Nov 23 09:07:11.767479 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 486/974] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:11 2021] GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:07:12.113474 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-cab3dd04-ceac-4633-805d-7b4b5c2a1c00 req-002e20c8-f0b4-4ea4-89dc-d8f12046f85b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06366ba9-6cab-4a74-97b6-d256cd9bd6d1", "name": "network-vif-plugged", "status": "completed", "tag": "4f3fac16-b08e-4467-807a-ffaf42239b72"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:07:12.115053 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:07:12.115053 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 09:07:12.124747 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-cab3dd04-ceac-4633-805d-7b4b5c2a1c00 req-002e20c8-f0b4-4ea4-89dc-d8f12046f85b service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:12.125401 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-cab3dd04-ceac-4633-805d-7b4b5c2a1c00 req-002e20c8-f0b4-4ea4-89dc-d8f12046f85b service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:12.138715 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-cab3dd04-ceac-4633-805d-7b4b5c2a1c00 req-002e20c8-f0b4-4ea4-89dc-d8f12046f85b service nova] Creating event network-vif-plugged:4f3fac16-b08e-4467-807a-ffaf42239b72 for instance 06366ba9-6cab-4a74-97b6-d256cd9bd6d1 on hv-cinder-76845 Nov 23 09:07:12.143696 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-cab3dd04-ceac-4633-805d-7b4b5c2a1c00 req-002e20c8-f0b4-4ea4-89dc-d8f12046f85b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034845 Nov 23 09:07:12.144362 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 489/975] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:07:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:07:12.375170 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-9a7dfcc6-950d-47bc-8f3d-03e5b83578df tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:12.375766 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-9a7dfcc6-950d-47bc-8f3d-03e5b83578df tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 83736d76-590f-4b9d-9044-f31d4620cec6] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:12.382481 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9a7dfcc6-950d-47bc-8f3d-03e5b83578df tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:12.382928 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9a7dfcc6-950d-47bc-8f3d-03e5b83578df tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:12.383701 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9a7dfcc6-950d-47bc-8f3d-03e5b83578df tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:12.385070 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9a7dfcc6-950d-47bc-8f3d-03e5b83578df tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:12.517902 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-9a7dfcc6-950d-47bc-8f3d-03e5b83578df tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:12.525085 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-9a7dfcc6-950d-47bc-8f3d-03e5b83578df tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6" status: 200 len: 1277 microversion: 2.1 time: 0.153596 Nov 23 09:07:12.525686 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 487/976] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:12 2021] GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6 => generated 1277 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:07:12.784674 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-69e49cf4-eec4-4657-b692-ff332aeb57d3 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:12.785437 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-69e49cf4-eec4-4657-b692-ff332aeb57d3 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:12.791483 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-69e49cf4-eec4-4657-b692-ff332aeb57d3 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:12.791936 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-69e49cf4-eec4-4657-b692-ff332aeb57d3 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:12.792708 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-69e49cf4-eec4-4657-b692-ff332aeb57d3 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:12.793144 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-69e49cf4-eec4-4657-b692-ff332aeb57d3 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:12.924654 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-69e49cf4-eec4-4657-b692-ff332aeb57d3 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197cb8739df848a6bc9de7a90b6da99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac6add618145708d682ab7de8fa3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:12.931949 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-69e49cf4-eec4-4657-b692-ff332aeb57d3 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 200 len: 1261 microversion: 2.1 time: 0.151254 Nov 23 09:07:12.933046 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 490/977] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:12 2021] GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:07:13.542288 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-db9ccf17-72fd-482b-9e6e-69abba613e78 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:13.542851 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-db9ccf17-72fd-482b-9e6e-69abba613e78 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 83736d76-590f-4b9d-9044-f31d4620cec6] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:13.548964 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-db9ccf17-72fd-482b-9e6e-69abba613e78 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:13.549444 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-db9ccf17-72fd-482b-9e6e-69abba613e78 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:13.550217 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-db9ccf17-72fd-482b-9e6e-69abba613e78 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:13.550647 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-db9ccf17-72fd-482b-9e6e-69abba613e78 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:13.681911 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-db9ccf17-72fd-482b-9e6e-69abba613e78 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:13.689145 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-db9ccf17-72fd-482b-9e6e-69abba613e78 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6" status: 200 len: 1277 microversion: 2.1 time: 0.151137 Nov 23 09:07:13.689741 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 488/978] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:13 2021] GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6 => generated 1277 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:07:13.949882 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-31f7b32e-c003-42a5-a9f2-b58f908b4477 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:13.950499 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-31f7b32e-c003-42a5-a9f2-b58f908b4477 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:13.956750 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-31f7b32e-c003-42a5-a9f2-b58f908b4477 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:13.957485 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-31f7b32e-c003-42a5-a9f2-b58f908b4477 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:13.958278 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-31f7b32e-c003-42a5-a9f2-b58f908b4477 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:13.958725 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-31f7b32e-c003-42a5-a9f2-b58f908b4477 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:14.098517 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-31f7b32e-c003-42a5-a9f2-b58f908b4477 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197cb8739df848a6bc9de7a90b6da99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac6add618145708d682ab7de8fa3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:14.105550 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-31f7b32e-c003-42a5-a9f2-b58f908b4477 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 200 len: 1446 microversion: 2.1 time: 0.160290 Nov 23 09:07:14.106116 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 491/979] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:13 2021] GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 1446 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:07:14.121755 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d93f190e-b9ca-40fa-aed5-7166177c6a47 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:14.122365 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d93f190e-b9ca-40fa-aed5-7166177c6a47 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:14.128096 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d93f190e-b9ca-40fa-aed5-7166177c6a47 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:14.128543 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d93f190e-b9ca-40fa-aed5-7166177c6a47 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:14.129336 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d93f190e-b9ca-40fa-aed5-7166177c6a47 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:14.129768 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d93f190e-b9ca-40fa-aed5-7166177c6a47 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:14.257978 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d93f190e-b9ca-40fa-aed5-7166177c6a47 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197cb8739df848a6bc9de7a90b6da99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac6add618145708d682ab7de8fa3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:14.266428 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d93f190e-b9ca-40fa-aed5-7166177c6a47 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 200 len: 1446 microversion: 2.1 time: 0.148998 Nov 23 09:07:14.267000 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 489/980] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:14 2021] GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 1446 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:07:14.707314 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-aa13af07-5b3f-4637-bdee-6ff93c55859a tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:14.707921 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-aa13af07-5b3f-4637-bdee-6ff93c55859a tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 83736d76-590f-4b9d-9044-f31d4620cec6] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:14.713810 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-aa13af07-5b3f-4637-bdee-6ff93c55859a tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:14.714255 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-aa13af07-5b3f-4637-bdee-6ff93c55859a tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:14.715032 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-aa13af07-5b3f-4637-bdee-6ff93c55859a tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:14.715469 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-aa13af07-5b3f-4637-bdee-6ff93c55859a tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:14.849178 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-aa13af07-5b3f-4637-bdee-6ff93c55859a tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:14.857300 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-aa13af07-5b3f-4637-bdee-6ff93c55859a tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6" status: 200 len: 1277 microversion: 2.1 time: 0.153936 Nov 23 09:07:14.858214 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 492/981] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:14 2021] GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6 => generated 1277 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:07:15.874826 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-5fa7a42b-8723-407b-8403-73299c528ecf tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:15.875446 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-5fa7a42b-8723-407b-8403-73299c528ecf tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 83736d76-590f-4b9d-9044-f31d4620cec6] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:15.882561 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5fa7a42b-8723-407b-8403-73299c528ecf tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:15.883019 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5fa7a42b-8723-407b-8403-73299c528ecf tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:15.883838 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5fa7a42b-8723-407b-8403-73299c528ecf tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:15.884312 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5fa7a42b-8723-407b-8403-73299c528ecf tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:15.963427 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-8385f01a-7cbe-4927-b070-12c9aa3db684 req-4f05ccf9-abd2-42c7-a070-65e079e4c305 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06366ba9-6cab-4a74-97b6-d256cd9bd6d1", "tag": "4f3fac16-b08e-4467-807a-ffaf42239b72"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:07:15.967161 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:07:15.967161 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 09:07:15.974627 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-8385f01a-7cbe-4927-b070-12c9aa3db684 req-4f05ccf9-abd2-42c7-a070-65e079e4c305 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:15.975162 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-8385f01a-7cbe-4927-b070-12c9aa3db684 req-4f05ccf9-abd2-42c7-a070-65e079e4c305 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:15.987299 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-8385f01a-7cbe-4927-b070-12c9aa3db684 req-4f05ccf9-abd2-42c7-a070-65e079e4c305 service nova] Creating event network-changed:4f3fac16-b08e-4467-807a-ffaf42239b72 for instance 06366ba9-6cab-4a74-97b6-d256cd9bd6d1 on hv-cinder-76845 Nov 23 09:07:15.992372 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-8385f01a-7cbe-4927-b070-12c9aa3db684 req-4f05ccf9-abd2-42c7-a070-65e079e4c305 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032702 Nov 23 09:07:15.992968 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 493/982] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:07:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 09:07:16.048633 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-5fa7a42b-8723-407b-8403-73299c528ecf tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:16.058777 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-5fa7a42b-8723-407b-8403-73299c528ecf tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6" status: 200 len: 1277 microversion: 2.1 time: 0.187471 Nov 23 09:07:16.059773 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 490/983] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:15 2021] GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6 => generated 1277 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:07:17.077378 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-abadb25b-5c94-420c-9ee6-57d542939330 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:17.078072 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-abadb25b-5c94-420c-9ee6-57d542939330 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 83736d76-590f-4b9d-9044-f31d4620cec6] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:17.084395 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-abadb25b-5c94-420c-9ee6-57d542939330 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:17.084849 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-abadb25b-5c94-420c-9ee6-57d542939330 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:17.085662 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-abadb25b-5c94-420c-9ee6-57d542939330 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:17.086105 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-abadb25b-5c94-420c-9ee6-57d542939330 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:17.203801 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-51d39366-9a90-491f-a608-79c374c68560 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:07:17.211076 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-51d39366-9a90-491f-a608-79c374c68560 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:17.211539 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-51d39366-9a90-491f-a608-79c374c68560 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:17.227086 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-abadb25b-5c94-420c-9ee6-57d542939330 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:17.234737 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-abadb25b-5c94-420c-9ee6-57d542939330 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6" status: 200 len: 1265 microversion: 2.1 time: 0.161801 Nov 23 09:07:17.235434 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 494/984] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:17 2021] GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:07:17.273905 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-51d39366-9a90-491f-a608-79c374c68560 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Going to try to stop instance {{(pid=116226) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 23 09:07:17.315066 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-51d39366-9a90-491f-a608-79c374c68560 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 202 len: 0 microversion: 2.1 time: 0.114776 Nov 23 09:07:17.315740 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 491/985] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:07:17 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 09:07:17.325133 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-c23c7e8e-8bd3-4f1d-9c8a-6a2a0fb453e2 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:17.325783 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-c23c7e8e-8bd3-4f1d-9c8a-6a2a0fb453e2 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:17.331505 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c23c7e8e-8bd3-4f1d-9c8a-6a2a0fb453e2 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:17.332222 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c23c7e8e-8bd3-4f1d-9c8a-6a2a0fb453e2 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:17.333070 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c23c7e8e-8bd3-4f1d-9c8a-6a2a0fb453e2 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:17.333572 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c23c7e8e-8bd3-4f1d-9c8a-6a2a0fb453e2 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:17.464641 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-c23c7e8e-8bd3-4f1d-9c8a-6a2a0fb453e2 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:17.472428 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-c23c7e8e-8bd3-4f1d-9c8a-6a2a0fb453e2 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1726 microversion: 2.1 time: 0.152456 Nov 23 09:07:17.472994 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 495/986] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:17 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:07:18.252879 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-fd5c9030-4ee4-4714-b04a-8a879dce2213 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:18.253535 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-fd5c9030-4ee4-4714-b04a-8a879dce2213 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 83736d76-590f-4b9d-9044-f31d4620cec6] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:18.260584 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fd5c9030-4ee4-4714-b04a-8a879dce2213 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:18.261036 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fd5c9030-4ee4-4714-b04a-8a879dce2213 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:18.261848 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fd5c9030-4ee4-4714-b04a-8a879dce2213 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:18.262289 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fd5c9030-4ee4-4714-b04a-8a879dce2213 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:18.392314 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-fd5c9030-4ee4-4714-b04a-8a879dce2213 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:18.400342 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-fd5c9030-4ee4-4714-b04a-8a879dce2213 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6" status: 200 len: 1265 microversion: 2.1 time: 0.151196 Nov 23 09:07:18.401085 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 492/987] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:18 2021] GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:07:18.489872 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-e0753a67-1a67-42ec-aae5-029a1c32139b tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:18.490472 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-e0753a67-1a67-42ec-aae5-029a1c32139b tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:18.497227 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e0753a67-1a67-42ec-aae5-029a1c32139b tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:18.497676 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e0753a67-1a67-42ec-aae5-029a1c32139b tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:18.498447 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e0753a67-1a67-42ec-aae5-029a1c32139b tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:18.498908 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e0753a67-1a67-42ec-aae5-029a1c32139b tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:18.625236 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-e0753a67-1a67-42ec-aae5-029a1c32139b tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:18.632835 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-e0753a67-1a67-42ec-aae5-029a1c32139b tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1726 microversion: 2.1 time: 0.146630 Nov 23 09:07:18.633429 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 496/988] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:18 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1726 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:07:19.418264 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f1dfde51-02f8-45c7-ad88-c41a217955d7 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:19.418883 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f1dfde51-02f8-45c7-ad88-c41a217955d7 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 83736d76-590f-4b9d-9044-f31d4620cec6] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:19.425137 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f1dfde51-02f8-45c7-ad88-c41a217955d7 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:19.425624 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f1dfde51-02f8-45c7-ad88-c41a217955d7 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:19.426413 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f1dfde51-02f8-45c7-ad88-c41a217955d7 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:19.426852 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f1dfde51-02f8-45c7-ad88-c41a217955d7 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:19.557625 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-f1dfde51-02f8-45c7-ad88-c41a217955d7 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:19.564746 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f1dfde51-02f8-45c7-ad88-c41a217955d7 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6" status: 200 len: 1265 microversion: 2.1 time: 0.151179 Nov 23 09:07:19.565338 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 493/989] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:19 2021] GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:07:19.651257 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-0fd4d872-79a0-4019-b93d-e86c9b073962 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:19.651863 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-0fd4d872-79a0-4019-b93d-e86c9b073962 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:19.658082 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0fd4d872-79a0-4019-b93d-e86c9b073962 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:19.658538 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0fd4d872-79a0-4019-b93d-e86c9b073962 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:19.659314 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0fd4d872-79a0-4019-b93d-e86c9b073962 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:19.659753 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0fd4d872-79a0-4019-b93d-e86c9b073962 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:19.790932 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-0fd4d872-79a0-4019-b93d-e86c9b073962 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:19.798586 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-0fd4d872-79a0-4019-b93d-e86c9b073962 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1726 microversion: 2.1 time: 0.151859 Nov 23 09:07:19.799163 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 497/990] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:19 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:07:20.582031 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-4b22ed55-b616-4621-a393-dc4739a6e167 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:20.582678 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-4b22ed55-b616-4621-a393-dc4739a6e167 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 83736d76-590f-4b9d-9044-f31d4620cec6] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:20.589416 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4b22ed55-b616-4621-a393-dc4739a6e167 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:20.589864 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4b22ed55-b616-4621-a393-dc4739a6e167 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:20.590630 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4b22ed55-b616-4621-a393-dc4739a6e167 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:20.591058 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4b22ed55-b616-4621-a393-dc4739a6e167 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:20.717624 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-4b22ed55-b616-4621-a393-dc4739a6e167 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:20.724703 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-4b22ed55-b616-4621-a393-dc4739a6e167 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6" status: 200 len: 1265 microversion: 2.1 time: 0.146526 Nov 23 09:07:20.725288 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 494/991] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:20 2021] GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:07:20.815066 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-2c1f3408-1208-411a-92b6-67c0ea08efee tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:20.815700 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-2c1f3408-1208-411a-92b6-67c0ea08efee tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:20.822254 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2c1f3408-1208-411a-92b6-67c0ea08efee tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:20.822705 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2c1f3408-1208-411a-92b6-67c0ea08efee tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:20.823480 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2c1f3408-1208-411a-92b6-67c0ea08efee tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:20.823916 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2c1f3408-1208-411a-92b6-67c0ea08efee tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:20.953875 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-2c1f3408-1208-411a-92b6-67c0ea08efee tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:20.962438 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-2c1f3408-1208-411a-92b6-67c0ea08efee tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1726 microversion: 2.1 time: 0.150490 Nov 23 09:07:20.963006 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 498/992] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:20 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:07:21.742273 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-204b869b-b783-41c7-846a-8235b888d1dc tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:21.743386 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-204b869b-b783-41c7-846a-8235b888d1dc tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 83736d76-590f-4b9d-9044-f31d4620cec6] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:21.749551 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-204b869b-b783-41c7-846a-8235b888d1dc tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:21.749996 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-204b869b-b783-41c7-846a-8235b888d1dc tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:21.750766 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-204b869b-b783-41c7-846a-8235b888d1dc tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:21.751195 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-204b869b-b783-41c7-846a-8235b888d1dc tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:21.881430 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-204b869b-b783-41c7-846a-8235b888d1dc tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:21.889076 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-204b869b-b783-41c7-846a-8235b888d1dc tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6" status: 200 len: 1265 microversion: 2.1 time: 0.150237 Nov 23 09:07:21.889780 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 495/993] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:21 2021] GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:07:21.980219 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-2794d339-1e44-41c0-a565-5ba32ba3c608 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:21.980822 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-2794d339-1e44-41c0-a565-5ba32ba3c608 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:21.987092 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2794d339-1e44-41c0-a565-5ba32ba3c608 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:21.987563 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2794d339-1e44-41c0-a565-5ba32ba3c608 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:21.988332 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2794d339-1e44-41c0-a565-5ba32ba3c608 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:21.988763 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2794d339-1e44-41c0-a565-5ba32ba3c608 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:22.121009 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-2794d339-1e44-41c0-a565-5ba32ba3c608 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:22.129396 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-2794d339-1e44-41c0-a565-5ba32ba3c608 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1726 microversion: 2.1 time: 0.153489 Nov 23 09:07:22.130017 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 499/994] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:21 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:07:22.906095 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-470f644e-3c61-4aa5-9e4f-926d244f15a9 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:22.906681 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-470f644e-3c61-4aa5-9e4f-926d244f15a9 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 83736d76-590f-4b9d-9044-f31d4620cec6] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:22.912878 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-470f644e-3c61-4aa5-9e4f-926d244f15a9 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:22.913368 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-470f644e-3c61-4aa5-9e4f-926d244f15a9 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:22.914134 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-470f644e-3c61-4aa5-9e4f-926d244f15a9 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:22.914596 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-470f644e-3c61-4aa5-9e4f-926d244f15a9 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:23.045387 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-470f644e-3c61-4aa5-9e4f-926d244f15a9 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:23.052631 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-470f644e-3c61-4aa5-9e4f-926d244f15a9 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6" status: 200 len: 1265 microversion: 2.1 time: 0.150177 Nov 23 09:07:23.053213 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 496/995] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:22 2021] GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:07:23.146226 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-bd8b13e8-b75a-4a88-8031-2f5f50456b22 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:23.146861 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-bd8b13e8-b75a-4a88-8031-2f5f50456b22 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:23.153775 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-bd8b13e8-b75a-4a88-8031-2f5f50456b22 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:23.154234 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-bd8b13e8-b75a-4a88-8031-2f5f50456b22 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:23.155014 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-bd8b13e8-b75a-4a88-8031-2f5f50456b22 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:23.155456 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-bd8b13e8-b75a-4a88-8031-2f5f50456b22 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:23.284699 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-bd8b13e8-b75a-4a88-8031-2f5f50456b22 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:23.293183 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-bd8b13e8-b75a-4a88-8031-2f5f50456b22 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1726 microversion: 2.1 time: 0.150617 Nov 23 09:07:23.293866 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 500/996] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:23 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:07:24.069433 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c7d3c21c-9410-42b8-918a-b58aaa9a408d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:24.070040 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c7d3c21c-9410-42b8-918a-b58aaa9a408d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 83736d76-590f-4b9d-9044-f31d4620cec6] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:24.076913 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c7d3c21c-9410-42b8-918a-b58aaa9a408d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:24.077415 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c7d3c21c-9410-42b8-918a-b58aaa9a408d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:24.078206 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c7d3c21c-9410-42b8-918a-b58aaa9a408d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:24.078640 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c7d3c21c-9410-42b8-918a-b58aaa9a408d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:24.210921 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-c7d3c21c-9410-42b8-918a-b58aaa9a408d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:24.218536 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c7d3c21c-9410-42b8-918a-b58aaa9a408d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6" status: 200 len: 1265 microversion: 2.1 time: 0.152739 Nov 23 09:07:24.219132 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 497/997] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:24 2021] GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:07:24.310914 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-533f5948-0463-4862-a617-2d81d83b302e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:24.311523 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-533f5948-0463-4862-a617-2d81d83b302e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:24.317820 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-533f5948-0463-4862-a617-2d81d83b302e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:24.318274 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-533f5948-0463-4862-a617-2d81d83b302e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:24.319054 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-533f5948-0463-4862-a617-2d81d83b302e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:24.319490 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-533f5948-0463-4862-a617-2d81d83b302e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:24.449029 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-533f5948-0463-4862-a617-2d81d83b302e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:24.456959 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-533f5948-0463-4862-a617-2d81d83b302e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1726 microversion: 2.1 time: 0.149549 Nov 23 09:07:24.457763 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 501/998] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:24 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:07:25.235529 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d3571074-d122-4e21-b9da-5ca325b66da2 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:25.236133 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d3571074-d122-4e21-b9da-5ca325b66da2 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 83736d76-590f-4b9d-9044-f31d4620cec6] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:25.242366 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d3571074-d122-4e21-b9da-5ca325b66da2 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:25.243326 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d3571074-d122-4e21-b9da-5ca325b66da2 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:25.244089 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d3571074-d122-4e21-b9da-5ca325b66da2 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:25.244517 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d3571074-d122-4e21-b9da-5ca325b66da2 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:25.474103 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-12531bc0-e0cc-4e29-8e1a-13e823519cd7 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:25.474659 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-12531bc0-e0cc-4e29-8e1a-13e823519cd7 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:25.480969 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-12531bc0-e0cc-4e29-8e1a-13e823519cd7 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:25.481472 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-12531bc0-e0cc-4e29-8e1a-13e823519cd7 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:25.482255 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-12531bc0-e0cc-4e29-8e1a-13e823519cd7 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:25.482689 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-12531bc0-e0cc-4e29-8e1a-13e823519cd7 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:25.616552 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-12531bc0-e0cc-4e29-8e1a-13e823519cd7 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:25.617121 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d3571074-d122-4e21-b9da-5ca325b66da2 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:25.624882 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d3571074-d122-4e21-b9da-5ca325b66da2 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6" status: 200 len: 1265 microversion: 2.1 time: 0.392942 Nov 23 09:07:25.625436 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-12531bc0-e0cc-4e29-8e1a-13e823519cd7 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1726 microversion: 2.1 time: 0.155145 Nov 23 09:07:25.625550 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 498/999] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:25 2021] GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6 => generated 1265 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:07:25.626013 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 502/1000] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:25 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:07:26.168687 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-7f380ba3-4c1f-4057-8693-289182627c5e req-ea6a1f5f-6bbd-4a33-bac6-7649c254cbfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83736d76-590f-4b9d-9044-f31d4620cec6", "name": "network-vif-plugged", "status": "completed", "tag": "8040e5ea-5091-448c-af26-6c32aed63601"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:07:26.170363 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:07:26.170363 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 09:07:26.178103 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-7f380ba3-4c1f-4057-8693-289182627c5e req-ea6a1f5f-6bbd-4a33-bac6-7649c254cbfa service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:26.178555 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-7f380ba3-4c1f-4057-8693-289182627c5e req-ea6a1f5f-6bbd-4a33-bac6-7649c254cbfa service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:26.190680 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-7f380ba3-4c1f-4057-8693-289182627c5e req-ea6a1f5f-6bbd-4a33-bac6-7649c254cbfa service nova] Creating event network-vif-plugged:8040e5ea-5091-448c-af26-6c32aed63601 for instance 83736d76-590f-4b9d-9044-f31d4620cec6 on hv-cinder-76845 Nov 23 09:07:26.195955 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-7f380ba3-4c1f-4057-8693-289182627c5e req-ea6a1f5f-6bbd-4a33-bac6-7649c254cbfa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031800 Nov 23 09:07:26.197219 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 499/1001] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:07:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:07:26.641250 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-17a91365-a2c9-4899-8e81-0b3e7b956391 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:26.641788 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-17a91365-a2c9-4899-8e81-0b3e7b956391 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:26.642858 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-dc223381-ec07-4e79-89bd-5fd4c01d720d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:26.643563 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-dc223381-ec07-4e79-89bd-5fd4c01d720d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 83736d76-590f-4b9d-9044-f31d4620cec6] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:26.647974 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-17a91365-a2c9-4899-8e81-0b3e7b956391 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:26.648425 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-17a91365-a2c9-4899-8e81-0b3e7b956391 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:26.650066 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-17a91365-a2c9-4899-8e81-0b3e7b956391 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:26.650508 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-17a91365-a2c9-4899-8e81-0b3e7b956391 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:26.651138 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dc223381-ec07-4e79-89bd-5fd4c01d720d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:26.651605 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dc223381-ec07-4e79-89bd-5fd4c01d720d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:26.652441 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dc223381-ec07-4e79-89bd-5fd4c01d720d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:26.652921 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dc223381-ec07-4e79-89bd-5fd4c01d720d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:26.782522 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-dc223381-ec07-4e79-89bd-5fd4c01d720d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:26.783285 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-17a91365-a2c9-4899-8e81-0b3e7b956391 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:26.789913 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-dc223381-ec07-4e79-89bd-5fd4c01d720d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6" status: 200 len: 1265 microversion: 2.1 time: 0.150944 Nov 23 09:07:26.790489 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 500/1002] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:26 2021] GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:07:26.791304 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-17a91365-a2c9-4899-8e81-0b3e7b956391 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1726 microversion: 2.1 time: 0.153790 Nov 23 09:07:26.791871 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 503/1003] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:26 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:07:27.806716 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a657c4f9-1c75-41ab-8e73-e89d89cdb4f8 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:27.807467 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a657c4f9-1c75-41ab-8e73-e89d89cdb4f8 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 83736d76-590f-4b9d-9044-f31d4620cec6] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:27.807613 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-5221bac3-ff2c-46dd-bc39-c96f156b67ab tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:27.808195 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-5221bac3-ff2c-46dd-bc39-c96f156b67ab tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:27.813559 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a657c4f9-1c75-41ab-8e73-e89d89cdb4f8 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:27.814012 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a657c4f9-1c75-41ab-8e73-e89d89cdb4f8 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:27.814367 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5221bac3-ff2c-46dd-bc39-c96f156b67ab tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:27.814795 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a657c4f9-1c75-41ab-8e73-e89d89cdb4f8 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:27.814903 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5221bac3-ff2c-46dd-bc39-c96f156b67ab tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:27.815239 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a657c4f9-1c75-41ab-8e73-e89d89cdb4f8 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:27.815588 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5221bac3-ff2c-46dd-bc39-c96f156b67ab tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:27.816026 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5221bac3-ff2c-46dd-bc39-c96f156b67ab tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:27.948771 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a657c4f9-1c75-41ab-8e73-e89d89cdb4f8 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:27.949379 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-5221bac3-ff2c-46dd-bc39-c96f156b67ab tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:27.956226 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a657c4f9-1c75-41ab-8e73-e89d89cdb4f8 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6" status: 200 len: 1452 microversion: 2.1 time: 0.153316 Nov 23 09:07:27.956990 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 501/1004] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:27 2021] GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:07:27.957339 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-5221bac3-ff2c-46dd-bc39-c96f156b67ab tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1726 microversion: 2.1 time: 0.153303 Nov 23 09:07:27.957971 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 504/1005] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:27 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:07:27.972978 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-baebc0c1-7ded-46a1-8c81-fae09dfa430d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:27.973606 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-baebc0c1-7ded-46a1-8c81-fae09dfa430d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 83736d76-590f-4b9d-9044-f31d4620cec6] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:27.980206 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-baebc0c1-7ded-46a1-8c81-fae09dfa430d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:27.980723 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-baebc0c1-7ded-46a1-8c81-fae09dfa430d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:27.981666 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-baebc0c1-7ded-46a1-8c81-fae09dfa430d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:27.982140 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-baebc0c1-7ded-46a1-8c81-fae09dfa430d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:28.110883 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-baebc0c1-7ded-46a1-8c81-fae09dfa430d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:28.118779 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-baebc0c1-7ded-46a1-8c81-fae09dfa430d tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6" status: 200 len: 1452 microversion: 2.1 time: 0.149471 Nov 23 09:07:28.119342 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 502/1006] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:27 2021] GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6 => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:07:28.974415 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-5b0ddabd-5a66-45a2-8289-6b9dafbf57b4 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:28.975128 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-5b0ddabd-5a66-45a2-8289-6b9dafbf57b4 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:28.982130 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5b0ddabd-5a66-45a2-8289-6b9dafbf57b4 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:28.982579 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5b0ddabd-5a66-45a2-8289-6b9dafbf57b4 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:28.983366 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5b0ddabd-5a66-45a2-8289-6b9dafbf57b4 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:28.983803 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-5b0ddabd-5a66-45a2-8289-6b9dafbf57b4 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:29.120026 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-5b0ddabd-5a66-45a2-8289-6b9dafbf57b4 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:29.127842 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-5b0ddabd-5a66-45a2-8289-6b9dafbf57b4 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1726 microversion: 2.1 time: 0.157081 Nov 23 09:07:29.128421 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 505/1007] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:28 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:07:29.676561 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-5cd7019d-b2c7-4e05-9940-18f1a5043a92 req-3f3bf88d-e80a-462e-bbe7-0268d18d2af7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83736d76-590f-4b9d-9044-f31d4620cec6", "tag": "8040e5ea-5091-448c-af26-6c32aed63601"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:07:29.678020 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:07:29.678020 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 09:07:29.685180 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-5cd7019d-b2c7-4e05-9940-18f1a5043a92 req-3f3bf88d-e80a-462e-bbe7-0268d18d2af7 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:29.685648 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-5cd7019d-b2c7-4e05-9940-18f1a5043a92 req-3f3bf88d-e80a-462e-bbe7-0268d18d2af7 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:29.696988 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-5cd7019d-b2c7-4e05-9940-18f1a5043a92 req-3f3bf88d-e80a-462e-bbe7-0268d18d2af7 service nova] Creating event network-changed:8040e5ea-5091-448c-af26-6c32aed63601 for instance 83736d76-590f-4b9d-9044-f31d4620cec6 on hv-cinder-76845 Nov 23 09:07:29.701940 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-5cd7019d-b2c7-4e05-9940-18f1a5043a92 req-3f3bf88d-e80a-462e-bbe7-0268d18d2af7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029708 Nov 23 09:07:29.702535 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 503/1008] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:07:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:07:30.145740 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-42d83883-86e1-47cd-913c-2f2b52c84d87 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:30.146882 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-42d83883-86e1-47cd-913c-2f2b52c84d87 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:30.153175 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-42d83883-86e1-47cd-913c-2f2b52c84d87 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:30.153647 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-42d83883-86e1-47cd-913c-2f2b52c84d87 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:30.154438 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-42d83883-86e1-47cd-913c-2f2b52c84d87 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:30.154879 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-42d83883-86e1-47cd-913c-2f2b52c84d87 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:30.338783 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-42d83883-86e1-47cd-913c-2f2b52c84d87 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:30.346713 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-42d83883-86e1-47cd-913c-2f2b52c84d87 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1726 microversion: 2.1 time: 0.204634 Nov 23 09:07:30.347288 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 506/1009] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:30 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1726 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:07:31.365618 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-3153bddf-98b7-44d2-9227-cab691389070 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:31.366245 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-3153bddf-98b7-44d2-9227-cab691389070 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:31.372818 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3153bddf-98b7-44d2-9227-cab691389070 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:31.373308 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3153bddf-98b7-44d2-9227-cab691389070 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:31.374092 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3153bddf-98b7-44d2-9227-cab691389070 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:31.374530 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3153bddf-98b7-44d2-9227-cab691389070 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:31.500291 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-3153bddf-98b7-44d2-9227-cab691389070 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:31.508024 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-3153bddf-98b7-44d2-9227-cab691389070 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1726 microversion: 2.1 time: 0.147106 Nov 23 09:07:31.509213 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 504/1010] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:31 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1726 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:07:32.526229 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-9b9d8f85-3ca9-4bf9-bc7b-b29597a10076 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:32.526780 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-9b9d8f85-3ca9-4bf9-bc7b-b29597a10076 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:32.532993 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9b9d8f85-3ca9-4bf9-bc7b-b29597a10076 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:32.533464 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9b9d8f85-3ca9-4bf9-bc7b-b29597a10076 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:32.534235 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9b9d8f85-3ca9-4bf9-bc7b-b29597a10076 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:32.534669 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9b9d8f85-3ca9-4bf9-bc7b-b29597a10076 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:32.665744 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-9b9d8f85-3ca9-4bf9-bc7b-b29597a10076 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:32.675072 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-9b9d8f85-3ca9-4bf9-bc7b-b29597a10076 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1726 microversion: 2.1 time: 0.152979 Nov 23 09:07:32.675654 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 507/1011] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:32 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:07:33.692085 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-7fe53954-f3f5-4e6c-9cee-fa7b5d7a1a65 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:33.692735 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-7fe53954-f3f5-4e6c-9cee-fa7b5d7a1a65 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:33.699336 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7fe53954-f3f5-4e6c-9cee-fa7b5d7a1a65 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:33.699790 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7fe53954-f3f5-4e6c-9cee-fa7b5d7a1a65 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:33.700574 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7fe53954-f3f5-4e6c-9cee-fa7b5d7a1a65 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:33.701016 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7fe53954-f3f5-4e6c-9cee-fa7b5d7a1a65 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:33.834935 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-7fe53954-f3f5-4e6c-9cee-fa7b5d7a1a65 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:33.843147 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-7fe53954-f3f5-4e6c-9cee-fa7b5d7a1a65 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1703 microversion: 2.1 time: 0.154742 Nov 23 09:07:33.843714 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 505/1012] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:33 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1703 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:07:33.859776 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-f5fe8484-f3a5-485a-bc87-d9cccb187d10 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:07:33.866057 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f5fe8484-f3a5-485a-bc87-d9cccb187d10 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:33.866508 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f5fe8484-f3a5-485a-bc87-d9cccb187d10 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:33.927306 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-f5fe8484-f3a5-485a-bc87-d9cccb187d10 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Going to try to start instance {{(pid=116227) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 23 09:07:33.969916 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-f5fe8484-f3a5-485a-bc87-d9cccb187d10 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 202 len: 0 microversion: 2.1 time: 0.113673 Nov 23 09:07:33.970709 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 508/1013] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:07:33 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:07:33.978693 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-36f0fa28-8222-49d6-8cc4-8cec4be4581e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:33.979295 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-36f0fa28-8222-49d6-8cc4-8cec4be4581e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:33.985025 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-36f0fa28-8222-49d6-8cc4-8cec4be4581e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:33.985612 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-36f0fa28-8222-49d6-8cc4-8cec4be4581e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:33.986529 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-36f0fa28-8222-49d6-8cc4-8cec4be4581e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:33.986986 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-36f0fa28-8222-49d6-8cc4-8cec4be4581e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:34.118104 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-36f0fa28-8222-49d6-8cc4-8cec4be4581e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:34.126047 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-36f0fa28-8222-49d6-8cc4-8cec4be4581e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1712 microversion: 2.1 time: 0.151136 Nov 23 09:07:34.126652 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 506/1014] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:33 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1712 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:07:35.144314 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-bed95ca8-e63a-4efe-acc8-8448dc331395 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:35.144995 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-bed95ca8-e63a-4efe-acc8-8448dc331395 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:35.152450 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-bed95ca8-e63a-4efe-acc8-8448dc331395 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:35.152897 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-bed95ca8-e63a-4efe-acc8-8448dc331395 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:35.153704 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-bed95ca8-e63a-4efe-acc8-8448dc331395 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:35.154142 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-bed95ca8-e63a-4efe-acc8-8448dc331395 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:35.288172 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-bed95ca8-e63a-4efe-acc8-8448dc331395 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:35.298327 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-bed95ca8-e63a-4efe-acc8-8448dc331395 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1712 microversion: 2.1 time: 0.157977 Nov 23 09:07:35.298908 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 509/1015] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:35 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1712 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:07:36.315683 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-2f99b47b-8519-4b02-a93d-e784bce5b395 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:07:36.316290 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-2f99b47b-8519-4b02-a93d-e784bce5b395 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:07:36.322780 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2f99b47b-8519-4b02-a93d-e784bce5b395 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:36.323234 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2f99b47b-8519-4b02-a93d-e784bce5b395 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:36.324010 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2f99b47b-8519-4b02-a93d-e784bce5b395 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:07:36.324455 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2f99b47b-8519-4b02-a93d-e784bce5b395 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:07:36.453148 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-2f99b47b-8519-4b02-a93d-e784bce5b395 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:07:36.461208 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-2f99b47b-8519-4b02-a93d-e784bce5b395 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1716 microversion: 2.1 time: 0.149409 Nov 23 09:07:36.461777 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 507/1016] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:07:36 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:08:11.432567 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-f1504a95-1172-4f6a-98ac-3d4bdff0cacf tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:08:11.433131 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-f1504a95-1172-4f6a-98ac-3d4bdff0cacf tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:08:11.438984 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f1504a95-1172-4f6a-98ac-3d4bdff0cacf tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:08:11.439441 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f1504a95-1172-4f6a-98ac-3d4bdff0cacf tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:08:11.440232 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f1504a95-1172-4f6a-98ac-3d4bdff0cacf tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:08:11.440672 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-f1504a95-1172-4f6a-98ac-3d4bdff0cacf tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:08:11.517365 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.objects.instance [None req-f1504a95-1172-4f6a-98ac-3d4bdff0cacf tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lazy-loading 'services' on Instance uuid ab769fa8-d310-4b1c-be00-7d2ded9d51a8 {{(pid=116227) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 09:08:11.584653 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-f1504a95-1172-4f6a-98ac-3d4bdff0cacf tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/os-volume_attachments/770079c3-b467-47ee-bf60-663afc85fa98" status: 202 len: 0 microversion: 2.1 time: 0.155732 Nov 23 09:08:11.585330 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 510/1017] 10.222.0.46 () {58 vars in 1415 bytes} [Tue Nov 23 09:08:11 2021] DELETE /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/os-volume_attachments/770079c3-b467-47ee-bf60-663afc85fa98 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:08:12.688965 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-23f989e0-b544-44c8-bf40-654e047610b2 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:08:12.695072 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-23f989e0-b544-44c8-bf40-654e047610b2 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:08:12.695529 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-23f989e0-b544-44c8-bf40-654e047610b2 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:08:12.718543 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-23f989e0-b544-44c8-bf40-654e047610b2 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Going to try to stop instance {{(pid=116226) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 23 09:08:12.757703 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-23f989e0-b544-44c8-bf40-654e047610b2 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 202 len: 0 microversion: 2.1 time: 0.072308 Nov 23 09:08:12.758305 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 508/1018] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:08:12 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:08:12.767618 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-bb9129de-4c63-460b-9b63-8b3a8ee7b517 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:08:12.768311 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-bb9129de-4c63-460b-9b63-8b3a8ee7b517 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:08:12.774649 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-bb9129de-4c63-460b-9b63-8b3a8ee7b517 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:08:12.775045 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-bb9129de-4c63-460b-9b63-8b3a8ee7b517 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:08:12.775892 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-bb9129de-4c63-460b-9b63-8b3a8ee7b517 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:08:12.776331 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-bb9129de-4c63-460b-9b63-8b3a8ee7b517 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:08:12.910624 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-bb9129de-4c63-460b-9b63-8b3a8ee7b517 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:08:12.917903 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-bb9129de-4c63-460b-9b63-8b3a8ee7b517 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1680 microversion: 2.1 time: 0.155371 Nov 23 09:08:12.918467 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 511/1019] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:08:12 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:08:13.936389 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-64e03e15-20fe-49ba-9208-78746901fd96 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:08:13.937068 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-64e03e15-20fe-49ba-9208-78746901fd96 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:08:13.943098 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-64e03e15-20fe-49ba-9208-78746901fd96 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:08:13.943546 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-64e03e15-20fe-49ba-9208-78746901fd96 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:08:13.944314 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-64e03e15-20fe-49ba-9208-78746901fd96 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:08:13.944742 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-64e03e15-20fe-49ba-9208-78746901fd96 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:08:14.071503 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-64e03e15-20fe-49ba-9208-78746901fd96 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:08:14.078846 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-64e03e15-20fe-49ba-9208-78746901fd96 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1680 microversion: 2.1 time: 0.147051 Nov 23 09:08:14.079414 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 509/1020] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:08:13 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1680 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:08:15.096830 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-7666bdf8-3ec4-46cd-aaa9-536dbf2836ed tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:08:15.097350 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-7666bdf8-3ec4-46cd-aaa9-536dbf2836ed tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:08:15.103704 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7666bdf8-3ec4-46cd-aaa9-536dbf2836ed tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:08:15.104162 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7666bdf8-3ec4-46cd-aaa9-536dbf2836ed tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:08:15.104951 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7666bdf8-3ec4-46cd-aaa9-536dbf2836ed tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:08:15.105420 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7666bdf8-3ec4-46cd-aaa9-536dbf2836ed tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:08:15.235463 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-7666bdf8-3ec4-46cd-aaa9-536dbf2836ed tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:08:15.242599 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-7666bdf8-3ec4-46cd-aaa9-536dbf2836ed tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1680 microversion: 2.1 time: 0.149678 Nov 23 09:08:15.243266 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 512/1021] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:08:15 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:08:16.258921 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-39444acc-e465-4692-be6a-e049ec12235a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:08:16.259464 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-39444acc-e465-4692-be6a-e049ec12235a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:08:16.265798 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-39444acc-e465-4692-be6a-e049ec12235a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:08:16.266246 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-39444acc-e465-4692-be6a-e049ec12235a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:08:16.267021 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-39444acc-e465-4692-be6a-e049ec12235a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:08:16.267457 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-39444acc-e465-4692-be6a-e049ec12235a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:08:16.392505 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-39444acc-e465-4692-be6a-e049ec12235a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:08:16.399798 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-39444acc-e465-4692-be6a-e049ec12235a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1680 microversion: 2.1 time: 0.144589 Nov 23 09:08:16.400364 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 510/1022] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:08:16 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1680 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:08:17.416933 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-8b45be9b-599c-4d5a-a1bf-129cb8c70eee tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:08:17.417530 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-8b45be9b-599c-4d5a-a1bf-129cb8c70eee tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:08:17.424001 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8b45be9b-599c-4d5a-a1bf-129cb8c70eee tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:08:17.424478 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8b45be9b-599c-4d5a-a1bf-129cb8c70eee tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:08:17.425279 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8b45be9b-599c-4d5a-a1bf-129cb8c70eee tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:08:17.425712 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8b45be9b-599c-4d5a-a1bf-129cb8c70eee tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:08:17.551365 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-8b45be9b-599c-4d5a-a1bf-129cb8c70eee tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:08:17.558555 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-8b45be9b-599c-4d5a-a1bf-129cb8c70eee tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1680 microversion: 2.1 time: 0.145280 Nov 23 09:08:17.559785 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 513/1023] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:08:17 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1680 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:08:18.576448 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-75ce68ce-5718-42ce-a21b-c041b70800e5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:08:18.577083 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-75ce68ce-5718-42ce-a21b-c041b70800e5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:08:18.583528 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-75ce68ce-5718-42ce-a21b-c041b70800e5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:08:18.584066 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-75ce68ce-5718-42ce-a21b-c041b70800e5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:08:18.584838 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-75ce68ce-5718-42ce-a21b-c041b70800e5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:08:18.585303 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-75ce68ce-5718-42ce-a21b-c041b70800e5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:08:18.714813 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-75ce68ce-5718-42ce-a21b-c041b70800e5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:08:18.722019 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-75ce68ce-5718-42ce-a21b-c041b70800e5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1680 microversion: 2.1 time: 0.149838 Nov 23 09:08:18.722588 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 511/1024] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:08:18 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:08:19.738405 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-6e01f157-b862-4eb9-bb94-708f9137a4d6 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:08:19.738988 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-6e01f157-b862-4eb9-bb94-708f9137a4d6 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:08:19.745210 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6e01f157-b862-4eb9-bb94-708f9137a4d6 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:08:19.745713 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6e01f157-b862-4eb9-bb94-708f9137a4d6 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:08:19.746488 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6e01f157-b862-4eb9-bb94-708f9137a4d6 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:08:19.746921 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6e01f157-b862-4eb9-bb94-708f9137a4d6 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:08:19.879473 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-6e01f157-b862-4eb9-bb94-708f9137a4d6 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:08:19.886727 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-6e01f157-b862-4eb9-bb94-708f9137a4d6 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1680 microversion: 2.1 time: 0.151925 Nov 23 09:08:19.887304 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 514/1025] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:08:19 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:08:20.905918 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-430f55b3-a642-4175-8de2-cddf5a958790 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:08:20.906528 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-430f55b3-a642-4175-8de2-cddf5a958790 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:08:20.912766 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-430f55b3-a642-4175-8de2-cddf5a958790 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:08:20.913243 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-430f55b3-a642-4175-8de2-cddf5a958790 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:08:20.914046 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-430f55b3-a642-4175-8de2-cddf5a958790 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:08:20.914477 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-430f55b3-a642-4175-8de2-cddf5a958790 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:08:21.043954 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-430f55b3-a642-4175-8de2-cddf5a958790 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:08:21.051183 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-430f55b3-a642-4175-8de2-cddf5a958790 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1680 microversion: 2.1 time: 0.149672 Nov 23 09:08:21.051775 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 512/1026] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:08:20 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:08:22.068400 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-4fbc25ab-85e4-453c-8ec9-a528b326bfc9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:08:22.069008 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-4fbc25ab-85e4-453c-8ec9-a528b326bfc9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:08:22.075341 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4fbc25ab-85e4-453c-8ec9-a528b326bfc9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:08:22.075801 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4fbc25ab-85e4-453c-8ec9-a528b326bfc9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:08:22.076611 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4fbc25ab-85e4-453c-8ec9-a528b326bfc9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:08:22.077054 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4fbc25ab-85e4-453c-8ec9-a528b326bfc9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:08:22.206257 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-4fbc25ab-85e4-453c-8ec9-a528b326bfc9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:08:22.213487 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-4fbc25ab-85e4-453c-8ec9-a528b326bfc9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1680 microversion: 2.1 time: 0.148698 Nov 23 09:08:22.214058 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 515/1027] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:08:22 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:08:23.230584 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-23ef47d6-0bcf-46e6-b033-4fe76ac31430 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:08:23.231186 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-23ef47d6-0bcf-46e6-b033-4fe76ac31430 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:08:23.237823 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-23ef47d6-0bcf-46e6-b033-4fe76ac31430 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:08:23.238267 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-23ef47d6-0bcf-46e6-b033-4fe76ac31430 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:08:23.239046 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-23ef47d6-0bcf-46e6-b033-4fe76ac31430 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:08:23.239459 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-23ef47d6-0bcf-46e6-b033-4fe76ac31430 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:08:23.367766 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-23ef47d6-0bcf-46e6-b033-4fe76ac31430 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:08:23.375628 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-23ef47d6-0bcf-46e6-b033-4fe76ac31430 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1657 microversion: 2.1 time: 0.148628 Nov 23 09:08:23.376192 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 513/1028] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:08:23 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1657 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:08:23.391731 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-1ab9df60-a2fe-474d-9794-2dc4c446b812 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:08:23.398015 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1ab9df60-a2fe-474d-9794-2dc4c446b812 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:08:23.398423 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1ab9df60-a2fe-474d-9794-2dc4c446b812 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:08:23.419606 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-1ab9df60-a2fe-474d-9794-2dc4c446b812 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Going to try to start instance {{(pid=116227) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 23 09:08:23.459399 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-1ab9df60-a2fe-474d-9794-2dc4c446b812 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action" status: 202 len: 0 microversion: 2.1 time: 0.071323 Nov 23 09:08:23.460000 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 516/1029] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:08:23 2021] POST /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/action => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:08:23.467769 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-4ae55a44-d856-486a-ada8-05d2fce6664a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:08:23.468459 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-4ae55a44-d856-486a-ada8-05d2fce6664a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:08:23.474227 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4ae55a44-d856-486a-ada8-05d2fce6664a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:08:23.474682 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4ae55a44-d856-486a-ada8-05d2fce6664a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:08:23.475462 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4ae55a44-d856-486a-ada8-05d2fce6664a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:08:23.475901 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4ae55a44-d856-486a-ada8-05d2fce6664a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:08:23.605549 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-4ae55a44-d856-486a-ada8-05d2fce6664a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:08:23.613846 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-4ae55a44-d856-486a-ada8-05d2fce6664a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1666 microversion: 2.1 time: 0.149728 Nov 23 09:08:23.614418 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 514/1030] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:08:23 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1666 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:08:24.631771 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-c52955e0-0497-483e-9628-642759212af3 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:08:24.632366 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-c52955e0-0497-483e-9628-642759212af3 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:08:24.639175 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c52955e0-0497-483e-9628-642759212af3 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:08:24.639645 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c52955e0-0497-483e-9628-642759212af3 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:08:24.640415 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c52955e0-0497-483e-9628-642759212af3 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:08:24.640850 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c52955e0-0497-483e-9628-642759212af3 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:08:24.768782 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-c52955e0-0497-483e-9628-642759212af3 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:08:24.775936 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-c52955e0-0497-483e-9628-642759212af3 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1670 microversion: 2.1 time: 0.148665 Nov 23 09:08:24.776554 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 517/1031] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:08:24 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1670 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:08:47.015401 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 09:08:47.016005 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: Tue Nov 23 09:08:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 09:08:57.501964 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e8070439-cb14-421e-8171-680380eeaecb tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:08:57.502920 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e8070439-cb14-421e-8171-680380eeaecb tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:08:57.508840 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e8070439-cb14-421e-8171-680380eeaecb tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:08:57.509327 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e8070439-cb14-421e-8171-680380eeaecb tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:08:57.510097 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e8070439-cb14-421e-8171-680380eeaecb tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:08:57.510532 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e8070439-cb14-421e-8171-680380eeaecb tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:08:57.539605 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e8070439-cb14-421e-8171-680380eeaecb tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042217 Nov 23 09:08:57.540154 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 515/1032] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 23 09:08:57 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 09:08:57.594148 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-e22f0b07-caba-41e9-a469-96b04937776c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:08:57.594648 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-e22f0b07-caba-41e9-a469-96b04937776c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:08:57.600417 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e22f0b07-caba-41e9-a469-96b04937776c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:08:57.600869 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e22f0b07-caba-41e9-a469-96b04937776c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:08:57.601683 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e22f0b07-caba-41e9-a469-96b04937776c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:08:57.602124 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e22f0b07-caba-41e9-a469-96b04937776c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:08:57.625922 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-e22f0b07-caba-41e9-a469-96b04937776c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Going to try to terminate instance {{(pid=116227) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 09:08:57.698427 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-e22f0b07-caba-41e9-a469-96b04937776c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 204 len: 0 microversion: 2.1 time: 0.107958 Nov 23 09:08:57.702337 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 518/1033] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 23 09:08:57 2021] DELETE /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 09:08:57.707666 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8354edef-a34f-4519-b7c0-6d7005300ed3 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:08:57.708238 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-8354edef-a34f-4519-b7c0-6d7005300ed3 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:08:57.714670 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8354edef-a34f-4519-b7c0-6d7005300ed3 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:08:57.715126 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8354edef-a34f-4519-b7c0-6d7005300ed3 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:08:57.715908 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8354edef-a34f-4519-b7c0-6d7005300ed3 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:08:57.716346 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8354edef-a34f-4519-b7c0-6d7005300ed3 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:08:57.902259 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-8354edef-a34f-4519-b7c0-6d7005300ed3 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:08:57.909529 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-8354edef-a34f-4519-b7c0-6d7005300ed3 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1676 microversion: 2.1 time: 0.205896 Nov 23 09:08:57.910090 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 516/1034] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:08:57 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1676 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:08:58.927306 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-ed5c5306-b30b-4bf6-89ed-b4a85d0cf314 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:08:58.928005 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-ed5c5306-b30b-4bf6-89ed-b4a85d0cf314 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:08:58.934232 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ed5c5306-b30b-4bf6-89ed-b4a85d0cf314 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:08:58.934684 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ed5c5306-b30b-4bf6-89ed-b4a85d0cf314 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:08:58.935764 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ed5c5306-b30b-4bf6-89ed-b4a85d0cf314 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:08:58.936160 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ed5c5306-b30b-4bf6-89ed-b4a85d0cf314 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:08:59.118850 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-ed5c5306-b30b-4bf6-89ed-b4a85d0cf314 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:08:59.126082 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-ed5c5306-b30b-4bf6-89ed-b4a85d0cf314 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1676 microversion: 2.1 time: 0.202902 Nov 23 09:08:59.126654 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 519/1035] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:08:58 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1676 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:09:00.142926 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-3084e8d0-7ab4-4c7e-b9f9-b4d85b12c1f1 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:00.143553 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-3084e8d0-7ab4-4c7e-b9f9-b4d85b12c1f1 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:00.149809 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3084e8d0-7ab4-4c7e-b9f9-b4d85b12c1f1 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:00.150259 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3084e8d0-7ab4-4c7e-b9f9-b4d85b12c1f1 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:00.151039 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3084e8d0-7ab4-4c7e-b9f9-b4d85b12c1f1 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:00.151474 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3084e8d0-7ab4-4c7e-b9f9-b4d85b12c1f1 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:00.283552 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-3084e8d0-7ab4-4c7e-b9f9-b4d85b12c1f1 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:09:00.291297 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-3084e8d0-7ab4-4c7e-b9f9-b4d85b12c1f1 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1676 microversion: 2.1 time: 0.151970 Nov 23 09:09:00.291887 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 517/1036] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:00 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:09:00.906892 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-d4a3a644-0cff-4d4d-92ec-58a9cd117f2f req-d235255f-6efe-41e2-8aa8-703730ab7fbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab769fa8-d310-4b1c-be00-7d2ded9d51a8", "name": "network-vif-deleted", "tag": "92ef3c22-1299-429d-a178-f4715346a0f5"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:00.909263 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:09:00.909263 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 09:09:00.919813 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-d4a3a644-0cff-4d4d-92ec-58a9cd117f2f req-d235255f-6efe-41e2-8aa8-703730ab7fbf service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:00.920636 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-d4a3a644-0cff-4d4d-92ec-58a9cd117f2f req-d235255f-6efe-41e2-8aa8-703730ab7fbf service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:00.933691 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-d4a3a644-0cff-4d4d-92ec-58a9cd117f2f req-d235255f-6efe-41e2-8aa8-703730ab7fbf service nova] Creating event network-vif-deleted:92ef3c22-1299-429d-a178-f4715346a0f5 for instance ab769fa8-d310-4b1c-be00-7d2ded9d51a8 on hv-cinder-76845 Nov 23 09:09:00.939042 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-d4a3a644-0cff-4d4d-92ec-58a9cd117f2f req-d235255f-6efe-41e2-8aa8-703730ab7fbf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036606 Nov 23 09:09:00.940147 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 520/1037] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:09:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:09:01.312231 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-067c843f-ecbe-44c3-81d6-7ecd47bd0c83 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:01.313504 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-067c843f-ecbe-44c3-81d6-7ecd47bd0c83 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:01.321339 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-067c843f-ecbe-44c3-81d6-7ecd47bd0c83 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:01.321801 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-067c843f-ecbe-44c3-81d6-7ecd47bd0c83 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:01.322594 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-067c843f-ecbe-44c3-81d6-7ecd47bd0c83 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:01.323037 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-067c843f-ecbe-44c3-81d6-7ecd47bd0c83 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:01.357095 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-067c843f-ecbe-44c3-81d6-7ecd47bd0c83 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:01.357577 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-067c843f-ecbe-44c3-81d6-7ecd47bd0c83 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:01.358051 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.objects.instance [None req-067c843f-ecbe-44c3-81d6-7ecd47bd0c83 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lazy-loading 'fault' on Instance uuid ab769fa8-d310-4b1c-be00-7d2ded9d51a8 {{(pid=116226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 09:09:01.398481 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-067c843f-ecbe-44c3-81d6-7ecd47bd0c83 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:09:01.405415 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-067c843f-ecbe-44c3-81d6-7ecd47bd0c83 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 200 len: 1328 microversion: 2.1 time: 0.099379 Nov 23 09:09:01.405997 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 518/1038] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:01 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 1328 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:09:02.423717 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-50f211ea-501f-4b0c-a5bc-e5d0c8957660 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:02.424418 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-50f211ea-501f-4b0c-a5bc-e5d0c8957660 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:02.431026 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-50f211ea-501f-4b0c-a5bc-e5d0c8957660 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:02.431484 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-50f211ea-501f-4b0c-a5bc-e5d0c8957660 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:02.432267 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-50f211ea-501f-4b0c-a5bc-e5d0c8957660 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:02.432707 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-50f211ea-501f-4b0c-a5bc-e5d0c8957660 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:02.447925 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.wsgi [None req-50f211ea-501f-4b0c-a5bc-e5d0c8957660 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] HTTP exception thrown: Instance ab769fa8-d310-4b1c-be00-7d2ded9d51a8 could not be found. Nov 23 09:09:02.448510 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-50f211ea-501f-4b0c-a5bc-e5d0c8957660 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Returning 404 to user: Instance ab769fa8-d310-4b1c-be00-7d2ded9d51a8 could not be found. {{(pid=116227) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 09:09:02.449355 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-50f211ea-501f-4b0c-a5bc-e5d0c8957660 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 404 len: 111 microversion: 2.1 time: 0.030631 Nov 23 09:09:02.449883 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 521/1039] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:02 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 09:09:02.458176 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-ca1ffabe-a4c9-4da2-9e08-96fad6790bf9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '.version_select at 0x7f527a314670>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:02.477874 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-ca1ffabe-a4c9-4da2-9e08-96fad6790bf9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1681989018" status: 202 len: 0 microversion: 2.1 time: 0.023221 Nov 23 09:09:02.478426 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 519/1040] 10.222.0.46 () {58 vars in 1220 bytes} [Tue Nov 23 09:09:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1681989018 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:09:03.110465 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-dc899c6f-9af7-4c17-bf3f-cdc0f299940f tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'create', calling method: .version_select at 0x7f527a291ca0>, body: {"keypair": {"name": "tempest-keypair-1173159375"}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:03.123755 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.quota [None req-dc899c6f-9af7-4c17-bf3f-cdc0f299940f tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Getting quotas for project 35872f178d144e849752bc7a845cb40d. Resources: {'key_pairs'} {{(pid=116227) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 09:09:03.127552 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.quota [None req-dc899c6f-9af7-4c17-bf3f-cdc0f299940f tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Getting quotas for user 06d848da2c21474b992041ca82e1d5e7 and project 35872f178d144e849752bc7a845cb40d. Resources: {'key_pairs'} {{(pid=116227) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 09:09:04.178426 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.quota [None req-dc899c6f-9af7-4c17-bf3f-cdc0f299940f tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Getting quotas for project 35872f178d144e849752bc7a845cb40d. Resources: {'key_pairs'} {{(pid=116227) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 09:09:04.182071 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.quota [None req-dc899c6f-9af7-4c17-bf3f-cdc0f299940f tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Getting quotas for user 06d848da2c21474b992041ca82e1d5e7 and project 35872f178d144e849752bc7a845cb40d. Resources: {'key_pairs'} {{(pid=116227) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 09:09:04.194686 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-dc899c6f-9af7-4c17-bf3f-cdc0f299940f tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.088053 Nov 23 09:09:04.195310 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 522/1041] 10.222.0.46 () {60 vars in 1157 bytes} [Tue Nov 23 09:09:03 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:09:05.437716 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c2c66bf0-a00b-46c7-8451-e1430f77140c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-172032766", "imageRef": "18424a16-ac32-42d5-8161-d6cb36423de3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c9e1bbdd-99f7-422e-846d-8219534d04c4"}], "security_groups": [{"name": "tempest-securitygroup--22242584"}], "key_name": "tempest-keypair-1173159375", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:05.536912 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.network.neutron [None req-c2c66bf0-a00b-46c7-8451-e1430f77140c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] validate_networks() for [('c9e1bbdd-99f7-422e-846d-8219534d04c4', None, None, None, None, None)] {{(pid=116226) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 09:09:05.905870 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-c2c66bf0-a00b-46c7-8451-e1430f77140c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Flavor limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 09:09:05.906312 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-c2c66bf0-a00b-46c7-8451-e1430f77140c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Image limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 09:09:05.906769 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-c2c66bf0-a00b-46c7-8451-e1430f77140c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Flavor pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 09:09:05.907180 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-c2c66bf0-a00b-46c7-8451-e1430f77140c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Image pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 09:09:05.907595 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-c2c66bf0-a00b-46c7-8451-e1430f77140c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 09:09:05.916058 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c2c66bf0-a00b-46c7-8451-e1430f77140c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:05.916503 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c2c66bf0-a00b-46c7-8451-e1430f77140c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:05.917359 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c2c66bf0-a00b-46c7-8451-e1430f77140c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:05.917802 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c2c66bf0-a00b-46c7-8451-e1430f77140c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:05.934303 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-c2c66bf0-a00b-46c7-8451-e1430f77140c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Getting quotas for project 35872f178d144e849752bc7a845cb40d. Resources: {'instances', 'ram', 'cores'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 09:09:05.938807 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-c2c66bf0-a00b-46c7-8451-e1430f77140c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Getting quotas for user 06d848da2c21474b992041ca82e1d5e7 and project 35872f178d144e849752bc7a845cb40d. Resources: {'instances', 'ram', 'cores'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 09:09:05.949346 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c2c66bf0-a00b-46c7-8451-e1430f77140c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Going to run 1 instances... {{(pid=116226) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 09:09:05.951646 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c2c66bf0-a00b-46c7-8451-e1430f77140c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='18424a16-ac32-42d5-8161-d6cb36423de3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116226) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 09:09:05.997558 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c2c66bf0-a00b-46c7-8451-e1430f77140c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.564271 Nov 23 09:09:05.998558 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 520/1042] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 23 09:09:05 2021] POST /compute/v2.1/servers => generated 400 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 09:09:06.009108 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-11ef6ed8-e4bb-4bd1-a4ed-46be62ffafa8 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:06.009767 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-11ef6ed8-e4bb-4bd1-a4ed-46be62ffafa8 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:06.064873 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-11ef6ed8-e4bb-4bd1-a4ed-46be62ffafa8 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:09:06.072110 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-11ef6ed8-e4bb-4bd1-a4ed-46be62ffafa8 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c" status: 200 len: 1237 microversion: 2.1 time: 0.067136 Nov 23 09:09:06.073231 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 523/1043] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:06 2021] GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:09:07.089935 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-4af679af-2b59-47d5-9d7a-00ce284d1a1d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:07.090579 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-4af679af-2b59-47d5-9d7a-00ce284d1a1d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:07.098465 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4af679af-2b59-47d5-9d7a-00ce284d1a1d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:07.098917 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4af679af-2b59-47d5-9d7a-00ce284d1a1d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:07.099710 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4af679af-2b59-47d5-9d7a-00ce284d1a1d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:07.100228 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4af679af-2b59-47d5-9d7a-00ce284d1a1d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:07.159435 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-4af679af-2b59-47d5-9d7a-00ce284d1a1d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:09:07.166634 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-4af679af-2b59-47d5-9d7a-00ce284d1a1d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c" status: 200 len: 1295 microversion: 2.1 time: 0.080992 Nov 23 09:09:07.167205 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 521/1044] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:07 2021] GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c => generated 1295 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:09:08.183698 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-069cf587-ce57-4cce-a91a-24bcbf2d79e9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:08.184939 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-069cf587-ce57-4cce-a91a-24bcbf2d79e9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:08.189945 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-5a583608-50b8-42e2-8ebd-06daddf4d540 req-4badeabf-b63b-4f3f-b083-1ff09a48bddf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c", "tag": "67286026-fc00-4ed2-868d-55778cbecc47"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:08.193992 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:09:08.193992 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 09:09:08.195832 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-069cf587-ce57-4cce-a91a-24bcbf2d79e9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:08.199255 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-069cf587-ce57-4cce-a91a-24bcbf2d79e9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:08.200235 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-069cf587-ce57-4cce-a91a-24bcbf2d79e9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:08.201214 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-069cf587-ce57-4cce-a91a-24bcbf2d79e9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:08.218327 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-5a583608-50b8-42e2-8ebd-06daddf4d540 req-4badeabf-b63b-4f3f-b083-1ff09a48bddf service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:08.218701 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-5a583608-50b8-42e2-8ebd-06daddf4d540 req-4badeabf-b63b-4f3f-b083-1ff09a48bddf service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:08.236664 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-5a583608-50b8-42e2-8ebd-06daddf4d540 req-4badeabf-b63b-4f3f-b083-1ff09a48bddf service nova] Creating event network-changed:67286026-fc00-4ed2-868d-55778cbecc47 for instance 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c on hv-cinder-76845 Nov 23 09:09:08.241662 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-5a583608-50b8-42e2-8ebd-06daddf4d540 req-4badeabf-b63b-4f3f-b083-1ff09a48bddf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056558 Nov 23 09:09:08.242533 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 522/1045] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:09:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:09:08.433680 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-069cf587-ce57-4cce-a91a-24bcbf2d79e9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:09:08.442147 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-069cf587-ce57-4cce-a91a-24bcbf2d79e9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c" status: 200 len: 1361 microversion: 2.1 time: 0.262056 Nov 23 09:09:08.442763 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 524/1046] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:08 2021] GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c => generated 1361 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:09:09.460529 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a27516bb-9941-449a-9cfb-b9c537465765 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:09.461234 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a27516bb-9941-449a-9cfb-b9c537465765 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:09.467681 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a27516bb-9941-449a-9cfb-b9c537465765 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:09.468129 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a27516bb-9941-449a-9cfb-b9c537465765 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:09.468901 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a27516bb-9941-449a-9cfb-b9c537465765 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:09.469368 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a27516bb-9941-449a-9cfb-b9c537465765 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:09.562737 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-46ca67be-8085-4e98-a703-4f294221794e tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:09.563247 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-46ca67be-8085-4e98-a703-4f294221794e tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 83736d76-590f-4b9d-9044-f31d4620cec6] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:09.569263 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-46ca67be-8085-4e98-a703-4f294221794e tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:09.569710 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-46ca67be-8085-4e98-a703-4f294221794e tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:09.570501 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-46ca67be-8085-4e98-a703-4f294221794e tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:09.570937 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-46ca67be-8085-4e98-a703-4f294221794e tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:09.596329 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-46ca67be-8085-4e98-a703-4f294221794e tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 83736d76-590f-4b9d-9044-f31d4620cec6] Going to try to terminate instance {{(pid=116227) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 09:09:09.633578 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a27516bb-9941-449a-9cfb-b9c537465765 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:09:09.642748 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a27516bb-9941-449a-9cfb-b9c537465765 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c" status: 200 len: 1361 microversion: 2.1 time: 0.186574 Nov 23 09:09:09.644099 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 523/1047] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:09 2021] GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c => generated 1361 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:09:09.648889 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-0e788193-ddcd-41a7-9a71-d2f4b5cac066 req-41886025-8c5b-414b-8de6-bb0bdc46a007 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83736d76-590f-4b9d-9044-f31d4620cec6", "tag": "8040e5ea-5091-448c-af26-6c32aed63601"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:09.650624 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:09:09.650624 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 09:09:09.664542 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-0e788193-ddcd-41a7-9a71-d2f4b5cac066 req-41886025-8c5b-414b-8de6-bb0bdc46a007 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:09.664992 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-0e788193-ddcd-41a7-9a71-d2f4b5cac066 req-41886025-8c5b-414b-8de6-bb0bdc46a007 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:09.677063 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-0e788193-ddcd-41a7-9a71-d2f4b5cac066 req-41886025-8c5b-414b-8de6-bb0bdc46a007 service nova] Creating event network-changed:8040e5ea-5091-448c-af26-6c32aed63601 for instance 83736d76-590f-4b9d-9044-f31d4620cec6 on hv-cinder-76845 Nov 23 09:09:09.682854 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-0e788193-ddcd-41a7-9a71-d2f4b5cac066 req-41886025-8c5b-414b-8de6-bb0bdc46a007 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037221 Nov 23 09:09:09.683735 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 524/1048] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:09:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:09:09.687565 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-46ca67be-8085-4e98-a703-4f294221794e tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "DELETE /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6" status: 204 len: 0 microversion: 2.1 time: 0.128748 Nov 23 09:09:09.688144 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 525/1049] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 23 09:09:09 2021] DELETE /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 09:09:09.697570 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-7c1a205b-d1b2-4e94-abf2-7eaec7b7d0f5 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:09.698260 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-7c1a205b-d1b2-4e94-abf2-7eaec7b7d0f5 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 83736d76-590f-4b9d-9044-f31d4620cec6] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:09.706007 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7c1a205b-d1b2-4e94-abf2-7eaec7b7d0f5 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:09.706461 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7c1a205b-d1b2-4e94-abf2-7eaec7b7d0f5 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:09.707242 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7c1a205b-d1b2-4e94-abf2-7eaec7b7d0f5 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:09.707673 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7c1a205b-d1b2-4e94-abf2-7eaec7b7d0f5 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:09.849439 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-7c1a205b-d1b2-4e94-abf2-7eaec7b7d0f5 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:09:09.857937 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-7c1a205b-d1b2-4e94-abf2-7eaec7b7d0f5 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6" status: 200 len: 1577 microversion: 2.1 time: 0.165317 Nov 23 09:09:09.858776 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 525/1050] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:09 2021] GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:09:10.660366 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-2c4238b9-0fdd-452f-bf6c-f8508e630b04 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:10.661068 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-2c4238b9-0fdd-452f-bf6c-f8508e630b04 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:10.667235 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2c4238b9-0fdd-452f-bf6c-f8508e630b04 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:10.667692 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2c4238b9-0fdd-452f-bf6c-f8508e630b04 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:10.668479 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2c4238b9-0fdd-452f-bf6c-f8508e630b04 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:10.668922 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2c4238b9-0fdd-452f-bf6c-f8508e630b04 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:10.805910 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-2c4238b9-0fdd-452f-bf6c-f8508e630b04 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:09:10.813216 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-2c4238b9-0fdd-452f-bf6c-f8508e630b04 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c" status: 200 len: 1361 microversion: 2.1 time: 0.156902 Nov 23 09:09:10.813776 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 526/1051] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:10 2021] GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:09:10.875281 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-6e8ab9a0-9804-49e6-9312-22d11129367a tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:10.875884 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-6e8ab9a0-9804-49e6-9312-22d11129367a tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 83736d76-590f-4b9d-9044-f31d4620cec6] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:10.882159 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6e8ab9a0-9804-49e6-9312-22d11129367a tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:10.882610 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6e8ab9a0-9804-49e6-9312-22d11129367a tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:10.883382 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6e8ab9a0-9804-49e6-9312-22d11129367a tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:10.883835 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6e8ab9a0-9804-49e6-9312-22d11129367a tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:11.015812 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-6e8ab9a0-9804-49e6-9312-22d11129367a tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:09:11.023169 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-6e8ab9a0-9804-49e6-9312-22d11129367a tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6" status: 200 len: 1458 microversion: 2.1 time: 0.151645 Nov 23 09:09:11.023736 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 526/1052] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:10 2021] GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6 => generated 1458 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:09:11.677293 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-ec6b6910-733f-4e1c-84fe-5dffb2e81fe2 req-b3337f01-239c-4905-bccb-50e35256b107 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83736d76-590f-4b9d-9044-f31d4620cec6", "name": "network-vif-deleted", "tag": "8040e5ea-5091-448c-af26-6c32aed63601"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:11.679864 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:09:11.679864 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 09:09:11.687548 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-ec6b6910-733f-4e1c-84fe-5dffb2e81fe2 req-b3337f01-239c-4905-bccb-50e35256b107 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:11.687996 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-ec6b6910-733f-4e1c-84fe-5dffb2e81fe2 req-b3337f01-239c-4905-bccb-50e35256b107 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:11.699470 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-ec6b6910-733f-4e1c-84fe-5dffb2e81fe2 req-b3337f01-239c-4905-bccb-50e35256b107 service nova] Creating event network-vif-deleted:8040e5ea-5091-448c-af26-6c32aed63601 for instance 83736d76-590f-4b9d-9044-f31d4620cec6 on hv-cinder-76845 Nov 23 09:09:11.704775 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-ec6b6910-733f-4e1c-84fe-5dffb2e81fe2 req-b3337f01-239c-4905-bccb-50e35256b107 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031432 Nov 23 09:09:11.705405 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 527/1053] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:09:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:09:11.830150 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b8b8bd87-6996-4dfe-904b-c67426335343 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:11.830752 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b8b8bd87-6996-4dfe-904b-c67426335343 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:11.836549 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b8b8bd87-6996-4dfe-904b-c67426335343 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:11.836994 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b8b8bd87-6996-4dfe-904b-c67426335343 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:11.837812 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b8b8bd87-6996-4dfe-904b-c67426335343 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:11.838244 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b8b8bd87-6996-4dfe-904b-c67426335343 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:11.977922 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b8b8bd87-6996-4dfe-904b-c67426335343 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:09:11.985640 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b8b8bd87-6996-4dfe-904b-c67426335343 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c" status: 200 len: 1361 microversion: 2.1 time: 0.159305 Nov 23 09:09:11.986406 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 527/1054] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:11 2021] GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:09:12.042575 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-a3f798fe-a052-45c8-abcd-24901bdfdd23 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:12.043375 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-a3f798fe-a052-45c8-abcd-24901bdfdd23 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 83736d76-590f-4b9d-9044-f31d4620cec6] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:12.050182 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a3f798fe-a052-45c8-abcd-24901bdfdd23 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:12.050649 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a3f798fe-a052-45c8-abcd-24901bdfdd23 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:12.051453 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a3f798fe-a052-45c8-abcd-24901bdfdd23 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:12.051890 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a3f798fe-a052-45c8-abcd-24901bdfdd23 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:12.084970 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a3f798fe-a052-45c8-abcd-24901bdfdd23 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:12.085576 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a3f798fe-a052-45c8-abcd-24901bdfdd23 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:12.086144 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.objects.instance [None req-a3f798fe-a052-45c8-abcd-24901bdfdd23 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lazy-loading 'fault' on Instance uuid 83736d76-590f-4b9d-9044-f31d4620cec6 {{(pid=116227) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 09:09:12.127278 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-a3f798fe-a052-45c8-abcd-24901bdfdd23 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:09:12.134633 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-a3f798fe-a052-45c8-abcd-24901bdfdd23 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6" status: 200 len: 1230 microversion: 2.1 time: 0.096029 Nov 23 09:09:12.135199 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 528/1055] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:12 2021] GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6 => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:09:12.712366 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-1a0afc50-22fc-4815-8464-dd0acdb5bdce req-181adaa8-4644-4546-b4c2-537c454d0ea8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c", "name": "network-vif-plugged", "status": "completed", "tag": "67286026-fc00-4ed2-868d-55778cbecc47"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:12.713889 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:09:12.713889 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 09:09:12.721707 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-1a0afc50-22fc-4815-8464-dd0acdb5bdce req-181adaa8-4644-4546-b4c2-537c454d0ea8 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:12.722154 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-1a0afc50-22fc-4815-8464-dd0acdb5bdce req-181adaa8-4644-4546-b4c2-537c454d0ea8 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:12.734179 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-1a0afc50-22fc-4815-8464-dd0acdb5bdce req-181adaa8-4644-4546-b4c2-537c454d0ea8 service nova] Creating event network-vif-plugged:67286026-fc00-4ed2-868d-55778cbecc47 for instance 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c on hv-cinder-76845 Nov 23 09:09:12.739129 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-1a0afc50-22fc-4815-8464-dd0acdb5bdce req-181adaa8-4644-4546-b4c2-537c454d0ea8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030589 Nov 23 09:09:12.740414 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 528/1056] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:09:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:09:13.003051 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-e3668f87-f669-440c-a805-cccb0e3fa22b tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:13.003663 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-e3668f87-f669-440c-a805-cccb0e3fa22b tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:13.009861 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e3668f87-f669-440c-a805-cccb0e3fa22b tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:13.010310 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e3668f87-f669-440c-a805-cccb0e3fa22b tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:13.011105 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e3668f87-f669-440c-a805-cccb0e3fa22b tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:13.011536 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e3668f87-f669-440c-a805-cccb0e3fa22b tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:13.139506 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-e3668f87-f669-440c-a805-cccb0e3fa22b tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:09:13.146490 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-e3668f87-f669-440c-a805-cccb0e3fa22b tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c" status: 200 len: 1361 microversion: 2.1 time: 0.147113 Nov 23 09:09:13.147057 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 529/1057] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:12 2021] GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c => generated 1361 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:09:13.152033 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8b9c7252-02bb-4f8d-9f72-55cfaad41f3c tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:13.152722 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-8b9c7252-02bb-4f8d-9f72-55cfaad41f3c tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 83736d76-590f-4b9d-9044-f31d4620cec6] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:13.159867 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8b9c7252-02bb-4f8d-9f72-55cfaad41f3c tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:13.160252 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8b9c7252-02bb-4f8d-9f72-55cfaad41f3c tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:13.161030 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8b9c7252-02bb-4f8d-9f72-55cfaad41f3c tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:13.161496 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8b9c7252-02bb-4f8d-9f72-55cfaad41f3c tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:13.174659 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-8b9c7252-02bb-4f8d-9f72-55cfaad41f3c tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] HTTP exception thrown: Instance 83736d76-590f-4b9d-9044-f31d4620cec6 could not be found. Nov 23 09:09:13.175237 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8b9c7252-02bb-4f8d-9f72-55cfaad41f3c tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Returning 404 to user: Instance 83736d76-590f-4b9d-9044-f31d4620cec6 could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 09:09:13.176040 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-8b9c7252-02bb-4f8d-9f72-55cfaad41f3c tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6" status: 404 len: 111 microversion: 2.1 time: 0.028053 Nov 23 09:09:13.176562 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 529/1058] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:13 2021] GET /compute/v2.1/servers/83736d76-590f-4b9d-9044-f31d4620cec6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 23 09:09:14.163274 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-8e4383d2-a388-4c19-8568-88452506ce6b tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:14.163941 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-8e4383d2-a388-4c19-8568-88452506ce6b tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:14.170485 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8e4383d2-a388-4c19-8568-88452506ce6b tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:14.170937 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8e4383d2-a388-4c19-8568-88452506ce6b tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:14.171747 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8e4383d2-a388-4c19-8568-88452506ce6b tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:14.172154 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-8e4383d2-a388-4c19-8568-88452506ce6b tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:14.303120 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-8e4383d2-a388-4c19-8568-88452506ce6b tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:09:14.310649 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-8e4383d2-a388-4c19-8568-88452506ce6b tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c" status: 200 len: 1547 microversion: 2.1 time: 0.150967 Nov 23 09:09:14.311220 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 530/1059] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:14 2021] GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:09:14.327160 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a39e1bab-0498-4cf0-87af-677eb02837a2 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:14.327676 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a39e1bab-0498-4cf0-87af-677eb02837a2 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:14.334082 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a39e1bab-0498-4cf0-87af-677eb02837a2 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:14.334543 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a39e1bab-0498-4cf0-87af-677eb02837a2 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:14.335331 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a39e1bab-0498-4cf0-87af-677eb02837a2 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:14.335769 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a39e1bab-0498-4cf0-87af-677eb02837a2 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:14.425629 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a39e1bab-0498-4cf0-87af-677eb02837a2 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102866 Nov 23 09:09:14.426235 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 530/1060] 10.222.0.46 () {58 vars in 1274 bytes} [Tue Nov 23 09:09:14 2021] GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:09:15.591436 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-bcabd49b-1434-4e30-b4fc-c990a8604078 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:15.593575 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-1e8484b2-200f-4614-b70b-244e52708446 req-2d44e1f2-ea16-427d-9677-cebcf83f2cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c", "tag": "67286026-fc00-4ed2-868d-55778cbecc47"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:15.595564 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:09:15.595564 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 09:09:15.599442 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-bcabd49b-1434-4e30-b4fc-c990a8604078 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:15.607802 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-bcabd49b-1434-4e30-b4fc-c990a8604078 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:15.610062 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-1e8484b2-200f-4614-b70b-244e52708446 req-2d44e1f2-ea16-427d-9677-cebcf83f2cd5 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:15.610506 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-1e8484b2-200f-4614-b70b-244e52708446 req-2d44e1f2-ea16-427d-9677-cebcf83f2cd5 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:15.613707 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-bcabd49b-1434-4e30-b4fc-c990a8604078 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:15.614502 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-bcabd49b-1434-4e30-b4fc-c990a8604078 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:15.614938 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-bcabd49b-1434-4e30-b4fc-c990a8604078 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:15.626955 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-1e8484b2-200f-4614-b70b-244e52708446 req-2d44e1f2-ea16-427d-9677-cebcf83f2cd5 service nova] Creating event network-changed:67286026-fc00-4ed2-868d-55778cbecc47 for instance 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c on hv-cinder-76845 Nov 23 09:09:15.632196 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-1e8484b2-200f-4614-b70b-244e52708446 req-2d44e1f2-ea16-427d-9677-cebcf83f2cd5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045421 Nov 23 09:09:15.633101 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 531/1061] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:09:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:09:15.690103 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-bcabd49b-1434-4e30-b4fc-c990a8604078 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action" status: 200 len: 14 microversion: 2.1 time: 0.106264 Nov 23 09:09:15.690742 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 531/1062] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:09:15 2021] POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 09:09:16.702165 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-00941105-6a6f-42d3-ae4d-b710d010d67e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:16.704031 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-00941105-6a6f-42d3-ae4d-b710d010d67e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:16.710456 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-00941105-6a6f-42d3-ae4d-b710d010d67e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:16.710922 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-00941105-6a6f-42d3-ae4d-b710d010d67e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:16.711743 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-00941105-6a6f-42d3-ae4d-b710d010d67e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:16.712179 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-00941105-6a6f-42d3-ae4d-b710d010d67e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:16.771201 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-00941105-6a6f-42d3-ae4d-b710d010d67e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action" status: 200 len: 14 microversion: 2.1 time: 0.073396 Nov 23 09:09:16.774769 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 532/1063] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:09:16 2021] POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 09:09:16.880564 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-9280c69c-a1f7-4858-94fb-4c317a67ccd4 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:16.881143 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-9280c69c-a1f7-4858-94fb-4c317a67ccd4 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 1385abf2-5cb6-424f-9768-048d7f9efaac] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:16.888319 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-033c2f50-173d-46d9-9722-e6d3bea512fe req-fcce6486-4e5d-45d9-a083-ebefd6df8fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1385abf2-5cb6-424f-9768-048d7f9efaac", "tag": "833fdf90-74a3-408c-a75b-f0c5c196ddcf"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:16.889827 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:09:16.889827 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 09:09:16.898435 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-033c2f50-173d-46d9-9722-e6d3bea512fe req-fcce6486-4e5d-45d9-a083-ebefd6df8fd7 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:16.898918 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-033c2f50-173d-46d9-9722-e6d3bea512fe req-fcce6486-4e5d-45d9-a083-ebefd6df8fd7 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:16.908121 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9280c69c-a1f7-4858-94fb-4c317a67ccd4 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:16.908569 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9280c69c-a1f7-4858-94fb-4c317a67ccd4 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:16.909381 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9280c69c-a1f7-4858-94fb-4c317a67ccd4 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:16.910003 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-9280c69c-a1f7-4858-94fb-4c317a67ccd4 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:16.913736 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-033c2f50-173d-46d9-9722-e6d3bea512fe req-fcce6486-4e5d-45d9-a083-ebefd6df8fd7 service nova] Creating event network-changed:833fdf90-74a3-408c-a75b-f0c5c196ddcf for instance 1385abf2-5cb6-424f-9768-048d7f9efaac on hv-cinder-76845 Nov 23 09:09:16.921889 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-033c2f50-173d-46d9-9722-e6d3bea512fe req-fcce6486-4e5d-45d9-a083-ebefd6df8fd7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037224 Nov 23 09:09:16.923612 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 533/1064] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:09:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:09:16.938521 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-9280c69c-a1f7-4858-94fb-4c317a67ccd4 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 1385abf2-5cb6-424f-9768-048d7f9efaac] Going to try to terminate instance {{(pid=116227) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 09:09:17.020012 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-9280c69c-a1f7-4858-94fb-4c317a67ccd4 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1385abf2-5cb6-424f-9768-048d7f9efaac" status: 204 len: 0 microversion: 2.1 time: 0.143302 Nov 23 09:09:17.021021 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 532/1065] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 23 09:09:16 2021] DELETE /compute/v2.1/servers/1385abf2-5cb6-424f-9768-048d7f9efaac => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 09:09:17.030326 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c59270ef-bc65-4eab-ae21-4d291db60bf7 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:17.031307 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c59270ef-bc65-4eab-ae21-4d291db60bf7 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 1385abf2-5cb6-424f-9768-048d7f9efaac] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:17.038069 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c59270ef-bc65-4eab-ae21-4d291db60bf7 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:17.038522 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c59270ef-bc65-4eab-ae21-4d291db60bf7 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:17.039316 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c59270ef-bc65-4eab-ae21-4d291db60bf7 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:17.039749 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c59270ef-bc65-4eab-ae21-4d291db60bf7 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:17.187458 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-c59270ef-bc65-4eab-ae21-4d291db60bf7 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:09:17.195695 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c59270ef-bc65-4eab-ae21-4d291db60bf7 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/1385abf2-5cb6-424f-9768-048d7f9efaac" status: 200 len: 1577 microversion: 2.1 time: 0.170140 Nov 23 09:09:17.196286 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 534/1066] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:17 2021] GET /compute/v2.1/servers/1385abf2-5cb6-424f-9768-048d7f9efaac => generated 1577 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:09:17.783653 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-7508e868-897b-42b3-9914-0b17a7bd4070 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:17.784652 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-7508e868-897b-42b3-9914-0b17a7bd4070 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:17.791309 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7508e868-897b-42b3-9914-0b17a7bd4070 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:17.791760 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7508e868-897b-42b3-9914-0b17a7bd4070 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:17.792550 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7508e868-897b-42b3-9914-0b17a7bd4070 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:17.792991 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7508e868-897b-42b3-9914-0b17a7bd4070 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:17.851335 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-7508e868-897b-42b3-9914-0b17a7bd4070 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action" status: 200 len: 14 microversion: 2.1 time: 0.071810 Nov 23 09:09:17.852104 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 533/1067] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:09:17 2021] POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 09:09:18.212326 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-cd1e0663-6911-4737-9ea7-6e9bcfc8b78b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:18.212916 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-cd1e0663-6911-4737-9ea7-6e9bcfc8b78b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 1385abf2-5cb6-424f-9768-048d7f9efaac] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:18.219164 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cd1e0663-6911-4737-9ea7-6e9bcfc8b78b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:18.219607 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cd1e0663-6911-4737-9ea7-6e9bcfc8b78b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:18.220378 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cd1e0663-6911-4737-9ea7-6e9bcfc8b78b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:18.220809 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cd1e0663-6911-4737-9ea7-6e9bcfc8b78b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:18.350293 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-cd1e0663-6911-4737-9ea7-6e9bcfc8b78b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:09:18.358139 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-cd1e0663-6911-4737-9ea7-6e9bcfc8b78b tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/1385abf2-5cb6-424f-9768-048d7f9efaac" status: 200 len: 1459 microversion: 2.1 time: 0.149503 Nov 23 09:09:18.358699 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 535/1068] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:18 2021] GET /compute/v2.1/servers/1385abf2-5cb6-424f-9768-048d7f9efaac => generated 1459 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:09:18.862720 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-73e5d35b-1937-4cbd-b5b0-3a0d880adb05 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:18.863723 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-73e5d35b-1937-4cbd-b5b0-3a0d880adb05 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:18.870866 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-73e5d35b-1937-4cbd-b5b0-3a0d880adb05 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:18.871327 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-73e5d35b-1937-4cbd-b5b0-3a0d880adb05 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:18.872334 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-73e5d35b-1937-4cbd-b5b0-3a0d880adb05 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:18.872787 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-73e5d35b-1937-4cbd-b5b0-3a0d880adb05 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:18.931264 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-73e5d35b-1937-4cbd-b5b0-3a0d880adb05 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action" status: 200 len: 14 microversion: 2.1 time: 0.072406 Nov 23 09:09:18.935151 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 534/1069] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:09:18 2021] POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 09:09:19.007812 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-9e6ed588-578e-4057-8923-7e7bbb7a6768 req-2ad5fb23-993f-43d8-9165-0ed2152909ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1385abf2-5cb6-424f-9768-048d7f9efaac", "name": "network-vif-deleted", "tag": "833fdf90-74a3-408c-a75b-f0c5c196ddcf"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:19.009498 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:09:19.009498 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 09:09:19.019547 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-9e6ed588-578e-4057-8923-7e7bbb7a6768 req-2ad5fb23-993f-43d8-9165-0ed2152909ad service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:19.020004 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-9e6ed588-578e-4057-8923-7e7bbb7a6768 req-2ad5fb23-993f-43d8-9165-0ed2152909ad service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:19.032292 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-9e6ed588-578e-4057-8923-7e7bbb7a6768 req-2ad5fb23-993f-43d8-9165-0ed2152909ad service nova] Creating event network-vif-deleted:833fdf90-74a3-408c-a75b-f0c5c196ddcf for instance 1385abf2-5cb6-424f-9768-048d7f9efaac on hv-cinder-76845 Nov 23 09:09:19.037318 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-9e6ed588-578e-4057-8923-7e7bbb7a6768 req-2ad5fb23-993f-43d8-9165-0ed2152909ad service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033566 Nov 23 09:09:19.037931 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 536/1070] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:09:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:09:19.375819 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-508cb090-b824-45fc-b4c7-6c8dbce39945 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:19.376735 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-508cb090-b824-45fc-b4c7-6c8dbce39945 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 1385abf2-5cb6-424f-9768-048d7f9efaac] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:19.383765 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-508cb090-b824-45fc-b4c7-6c8dbce39945 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:19.384216 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-508cb090-b824-45fc-b4c7-6c8dbce39945 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:19.385007 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-508cb090-b824-45fc-b4c7-6c8dbce39945 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:19.385477 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-508cb090-b824-45fc-b4c7-6c8dbce39945 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:19.425681 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-508cb090-b824-45fc-b4c7-6c8dbce39945 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:19.426141 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-508cb090-b824-45fc-b4c7-6c8dbce39945 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:19.426595 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.objects.instance [None req-508cb090-b824-45fc-b4c7-6c8dbce39945 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lazy-loading 'fault' on Instance uuid 1385abf2-5cb6-424f-9768-048d7f9efaac {{(pid=116227) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 09:09:19.470157 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-508cb090-b824-45fc-b4c7-6c8dbce39945 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e26aa2383ab4e5da1bdc6712f58af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229671159ee9412ca1bcc93a838c73c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:09:19.477442 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-508cb090-b824-45fc-b4c7-6c8dbce39945 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/1385abf2-5cb6-424f-9768-048d7f9efaac" status: 200 len: 1231 microversion: 2.1 time: 0.105823 Nov 23 09:09:19.478002 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 535/1071] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:19 2021] GET /compute/v2.1/servers/1385abf2-5cb6-424f-9768-048d7f9efaac => generated 1231 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:09:19.943781 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-4f1b525f-7fc4-4ebd-8c16-cea92cc97137 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:19.944769 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-4f1b525f-7fc4-4ebd-8c16-cea92cc97137 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:19.951310 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4f1b525f-7fc4-4ebd-8c16-cea92cc97137 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:19.951761 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4f1b525f-7fc4-4ebd-8c16-cea92cc97137 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:19.952537 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4f1b525f-7fc4-4ebd-8c16-cea92cc97137 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:19.952974 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4f1b525f-7fc4-4ebd-8c16-cea92cc97137 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:20.016259 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-4f1b525f-7fc4-4ebd-8c16-cea92cc97137 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action" status: 200 len: 14 microversion: 2.1 time: 0.076839 Nov 23 09:09:20.016870 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 537/1072] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:09:19 2021] POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 23 09:09:20.494384 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-0c5308d6-25b4-41ee-9b35-a550c271b1e0 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:20.494990 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-0c5308d6-25b4-41ee-9b35-a550c271b1e0 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 1385abf2-5cb6-424f-9768-048d7f9efaac] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:20.501977 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0c5308d6-25b4-41ee-9b35-a550c271b1e0 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:20.502427 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0c5308d6-25b4-41ee-9b35-a550c271b1e0 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:20.503199 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0c5308d6-25b4-41ee-9b35-a550c271b1e0 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:20.503631 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0c5308d6-25b4-41ee-9b35-a550c271b1e0 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:20.516930 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.wsgi [None req-0c5308d6-25b4-41ee-9b35-a550c271b1e0 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] HTTP exception thrown: Instance 1385abf2-5cb6-424f-9768-048d7f9efaac could not be found. Nov 23 09:09:20.517527 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-0c5308d6-25b4-41ee-9b35-a550c271b1e0 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Returning 404 to user: Instance 1385abf2-5cb6-424f-9768-048d7f9efaac could not be found. {{(pid=116227) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 09:09:20.518356 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-0c5308d6-25b4-41ee-9b35-a550c271b1e0 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/1385abf2-5cb6-424f-9768-048d7f9efaac" status: 404 len: 111 microversion: 2.1 time: 0.027636 Nov 23 09:09:20.518869 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 536/1073] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:20 2021] GET /compute/v2.1/servers/1385abf2-5cb6-424f-9768-048d7f9efaac => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 09:09:20.948501 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e217fbec-3e62-4a26-a738-6ed3b0c3fc41 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:20.949118 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e217fbec-3e62-4a26-a738-6ed3b0c3fc41 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:20.956630 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e217fbec-3e62-4a26-a738-6ed3b0c3fc41 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:20.957081 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e217fbec-3e62-4a26-a738-6ed3b0c3fc41 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:20.957918 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e217fbec-3e62-4a26-a738-6ed3b0c3fc41 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:20.958381 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e217fbec-3e62-4a26-a738-6ed3b0c3fc41 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:20.971424 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-11d3e6e9-5baa-4373-977f-1b088fb3c858 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:20.972091 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-11d3e6e9-5baa-4373-977f-1b088fb3c858 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:20.978466 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-11d3e6e9-5baa-4373-977f-1b088fb3c858 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:20.978925 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-11d3e6e9-5baa-4373-977f-1b088fb3c858 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:20.979730 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-11d3e6e9-5baa-4373-977f-1b088fb3c858 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:20.980176 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-11d3e6e9-5baa-4373-977f-1b088fb3c858 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:20.986575 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.objects.instance [None req-e217fbec-3e62-4a26-a738-6ed3b0c3fc41 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lazy-loading 'flavor' on Instance uuid 06366ba9-6cab-4a74-97b6-d256cd9bd6d1 {{(pid=116226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 09:09:20.997560 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.wsgi [None req-11d3e6e9-5baa-4373-977f-1b088fb3c858 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] HTTP exception thrown: Instance 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 could not be found. Nov 23 09:09:20.998258 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-11d3e6e9-5baa-4373-977f-1b088fb3c858 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Returning 404 to user: Instance 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 could not be found. {{(pid=116227) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 09:09:20.999521 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-11d3e6e9-5baa-4373-977f-1b088fb3c858 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22" status: 404 len: 111 microversion: 2.1 time: 0.032013 Nov 23 09:09:21.000097 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 537/1074] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 23 09:09:20 2021] DELETE /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 09:09:21.007783 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-2ce5fabd-a545-483a-b3a1-885d2be41d92 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:21.008428 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-2ce5fabd-a545-483a-b3a1-885d2be41d92 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] [instance: 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:21.014740 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2ce5fabd-a545-483a-b3a1-885d2be41d92 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:21.015192 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2ce5fabd-a545-483a-b3a1-885d2be41d92 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:21.016002 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2ce5fabd-a545-483a-b3a1-885d2be41d92 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:21.016440 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2ce5fabd-a545-483a-b3a1-885d2be41d92 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:21.029653 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.wsgi [None req-2ce5fabd-a545-483a-b3a1-885d2be41d92 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] HTTP exception thrown: Instance 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 could not be found. Nov 23 09:09:21.030236 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-2ce5fabd-a545-483a-b3a1-885d2be41d92 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Returning 404 to user: Instance 6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 could not be found. {{(pid=116227) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 09:09:21.031077 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-2ce5fabd-a545-483a-b3a1-885d2be41d92 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22" status: 404 len: 111 microversion: 2.1 time: 0.026794 Nov 23 09:09:21.034801 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 538/1075] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:21 2021] GET /compute/v2.1/servers/6fcc9f31-a3b6-4476-9c2f-6b22faa98e22 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 23 09:09:21.036069 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-1bcc8f54-e7d1-458d-92b4-d1ce99758050 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:21.036968 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-1bcc8f54-e7d1-458d-92b4-d1ce99758050 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:21.042940 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1bcc8f54-e7d1-458d-92b4-d1ce99758050 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:21.043390 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1bcc8f54-e7d1-458d-92b4-d1ce99758050 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:21.044812 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1bcc8f54-e7d1-458d-92b4-d1ce99758050 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:21.045351 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1bcc8f54-e7d1-458d-92b4-d1ce99758050 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:21.065132 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e217fbec-3e62-4a26-a738-6ed3b0c3fc41 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "POST /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1/action" status: 202 len: 0 microversion: 2.1 time: 0.120129 Nov 23 09:09:21.065980 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 538/1076] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:09:20 2021] POST /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:09:21.076759 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-fec24b7f-0081-4171-b82c-520a45982d75 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:21.078009 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-fec24b7f-0081-4171-b82c-520a45982d75 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:21.085071 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fec24b7f-0081-4171-b82c-520a45982d75 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:21.085552 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fec24b7f-0081-4171-b82c-520a45982d75 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:21.086350 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fec24b7f-0081-4171-b82c-520a45982d75 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:21.086786 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fec24b7f-0081-4171-b82c-520a45982d75 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:21.111549 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-1bcc8f54-e7d1-458d-92b4-d1ce99758050 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action" status: 200 len: 14 microversion: 2.1 time: 0.078722 Nov 23 09:09:21.114803 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 539/1077] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:09:21 2021] POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 09:09:21.224027 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-fec24b7f-0081-4171-b82c-520a45982d75 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197cb8739df848a6bc9de7a90b6da99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac6add618145708d682ab7de8fa3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:09:21.232267 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-fec24b7f-0081-4171-b82c-520a45982d75 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 200 len: 1570 microversion: 2.1 time: 0.160594 Nov 23 09:09:21.232809 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 539/1078] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:21 2021] GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:09:22.123830 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-0b7ab27b-fd51-4465-a49e-f383a20223f4 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:22.124862 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-0b7ab27b-fd51-4465-a49e-f383a20223f4 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:22.131748 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0b7ab27b-fd51-4465-a49e-f383a20223f4 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:22.132205 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0b7ab27b-fd51-4465-a49e-f383a20223f4 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:22.132993 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0b7ab27b-fd51-4465-a49e-f383a20223f4 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:22.133466 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-0b7ab27b-fd51-4465-a49e-f383a20223f4 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:22.195808 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-0b7ab27b-fd51-4465-a49e-f383a20223f4 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action" status: 200 len: 14 microversion: 2.1 time: 0.076717 Nov 23 09:09:22.196470 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 540/1079] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:09:22 2021] POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 09:09:22.250157 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-0d392993-88cb-463b-86f6-365bddf8abb4 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:22.250762 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-0d392993-88cb-463b-86f6-365bddf8abb4 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:22.256959 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0d392993-88cb-463b-86f6-365bddf8abb4 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:22.257443 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0d392993-88cb-463b-86f6-365bddf8abb4 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:22.258217 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0d392993-88cb-463b-86f6-365bddf8abb4 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:22.258644 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0d392993-88cb-463b-86f6-365bddf8abb4 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:22.332294 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-e9e62608-aafd-49ab-894a-2e7ab6d76301 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] Calling method '.version_select at 0x7f527a1d7670>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:22.357105 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-e9e62608-aafd-49ab-894a-2e7ab6d76301 tempest-TestVolumeBootPattern-1402912952 tempest-TestVolumeBootPattern-1402912952-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1835873804" status: 202 len: 0 microversion: 2.1 time: 0.028779 Nov 23 09:09:22.357764 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 541/1080] 10.222.0.46 () {58 vars in 1262 bytes} [Tue Nov 23 09:09:22 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1835873804 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 09:09:22.401263 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-0d392993-88cb-463b-86f6-365bddf8abb4 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197cb8739df848a6bc9de7a90b6da99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac6add618145708d682ab7de8fa3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:09:22.408764 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-0d392993-88cb-463b-86f6-365bddf8abb4 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 200 len: 1570 microversion: 2.1 time: 0.162974 Nov 23 09:09:22.409393 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 540/1081] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:22 2021] GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:09:23.207839 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-e287b39d-bdfe-44a8-bf56-a6f99ecb9bb4 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:23.208860 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-e287b39d-bdfe-44a8-bf56-a6f99ecb9bb4 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:23.215364 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e287b39d-bdfe-44a8-bf56-a6f99ecb9bb4 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:23.216436 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e287b39d-bdfe-44a8-bf56-a6f99ecb9bb4 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:23.217262 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e287b39d-bdfe-44a8-bf56-a6f99ecb9bb4 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:23.217704 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e287b39d-bdfe-44a8-bf56-a6f99ecb9bb4 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:23.275657 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-e287b39d-bdfe-44a8-bf56-a6f99ecb9bb4 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action" status: 200 len: 14 microversion: 2.1 time: 0.071999 Nov 23 09:09:23.276241 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 542/1082] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:09:23 2021] POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 09:09:23.427062 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-bd12753e-cff4-42b3-9fd4-2af19d3fc548 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:23.428385 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-bd12753e-cff4-42b3-9fd4-2af19d3fc548 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:23.437648 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bd12753e-cff4-42b3-9fd4-2af19d3fc548 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:23.438514 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bd12753e-cff4-42b3-9fd4-2af19d3fc548 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:23.439420 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bd12753e-cff4-42b3-9fd4-2af19d3fc548 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:23.439949 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bd12753e-cff4-42b3-9fd4-2af19d3fc548 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:23.583324 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-bd12753e-cff4-42b3-9fd4-2af19d3fc548 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197cb8739df848a6bc9de7a90b6da99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac6add618145708d682ab7de8fa3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:09:23.590794 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-bd12753e-cff4-42b3-9fd4-2af19d3fc548 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 200 len: 1570 microversion: 2.1 time: 0.168609 Nov 23 09:09:23.591480 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 541/1083] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:23 2021] GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 1570 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:09:24.287818 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-7b0f8fda-9be5-4c66-b609-9eebde1a8033 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:24.288854 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-7b0f8fda-9be5-4c66-b609-9eebde1a8033 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:24.296674 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7b0f8fda-9be5-4c66-b609-9eebde1a8033 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:24.297129 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7b0f8fda-9be5-4c66-b609-9eebde1a8033 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:24.297981 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7b0f8fda-9be5-4c66-b609-9eebde1a8033 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:24.298424 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-7b0f8fda-9be5-4c66-b609-9eebde1a8033 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:24.360129 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-7b0f8fda-9be5-4c66-b609-9eebde1a8033 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action" status: 200 len: 14 microversion: 2.1 time: 0.076239 Nov 23 09:09:24.364281 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 543/1084] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:09:24 2021] POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 09:09:24.608249 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b15197ff-af2b-478f-a16c-170ed7b62f4d tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:24.609127 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b15197ff-af2b-478f-a16c-170ed7b62f4d tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:24.616259 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b15197ff-af2b-478f-a16c-170ed7b62f4d tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:24.617042 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b15197ff-af2b-478f-a16c-170ed7b62f4d tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:24.617949 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b15197ff-af2b-478f-a16c-170ed7b62f4d tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:24.618478 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b15197ff-af2b-478f-a16c-170ed7b62f4d tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:24.917252 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b15197ff-af2b-478f-a16c-170ed7b62f4d tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197cb8739df848a6bc9de7a90b6da99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac6add618145708d682ab7de8fa3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:09:24.925781 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b15197ff-af2b-478f-a16c-170ed7b62f4d tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 200 len: 1570 microversion: 2.1 time: 0.321711 Nov 23 09:09:24.929204 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 542/1085] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:24 2021] GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 1570 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:09:25.373067 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-cab8910d-c754-4e44-9515-4e7d643f4f0a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:25.374176 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-cab8910d-c754-4e44-9515-4e7d643f4f0a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:25.381024 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-cab8910d-c754-4e44-9515-4e7d643f4f0a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:25.381512 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-cab8910d-c754-4e44-9515-4e7d643f4f0a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:25.382293 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-cab8910d-c754-4e44-9515-4e7d643f4f0a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:25.382731 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-cab8910d-c754-4e44-9515-4e7d643f4f0a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:25.442012 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-cab8910d-c754-4e44-9515-4e7d643f4f0a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action" status: 200 len: 14 microversion: 2.1 time: 0.073514 Nov 23 09:09:25.445285 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 544/1086] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:09:25 2021] POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 09:09:25.946333 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c5136583-8863-469c-aa85-c1f84806046b tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:25.947059 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c5136583-8863-469c-aa85-c1f84806046b tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:25.953823 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c5136583-8863-469c-aa85-c1f84806046b tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:25.954282 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c5136583-8863-469c-aa85-c1f84806046b tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:25.955067 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c5136583-8863-469c-aa85-c1f84806046b tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:25.955510 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c5136583-8863-469c-aa85-c1f84806046b tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:26.089948 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-c5136583-8863-469c-aa85-c1f84806046b tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197cb8739df848a6bc9de7a90b6da99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac6add618145708d682ab7de8fa3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:09:26.099024 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c5136583-8863-469c-aa85-c1f84806046b tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 200 len: 1570 microversion: 2.1 time: 0.156401 Nov 23 09:09:26.099676 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 543/1087] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:25 2021] GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:09:26.456202 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-df547d2c-6df9-406d-8504-882b75c6c823 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:26.457517 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-df547d2c-6df9-406d-8504-882b75c6c823 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:26.464377 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-df547d2c-6df9-406d-8504-882b75c6c823 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:26.464828 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-df547d2c-6df9-406d-8504-882b75c6c823 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:26.466294 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-df547d2c-6df9-406d-8504-882b75c6c823 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:26.466888 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-df547d2c-6df9-406d-8504-882b75c6c823 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:26.536475 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-df547d2c-6df9-406d-8504-882b75c6c823 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action" status: 200 len: 14 microversion: 2.1 time: 0.086262 Nov 23 09:09:26.537312 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 545/1088] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:09:26 2021] POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 09:09:27.122705 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-0bf4e869-4b4e-43e6-8d65-4440063ce19c tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:27.130038 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-0bf4e869-4b4e-43e6-8d65-4440063ce19c tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:27.136625 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0bf4e869-4b4e-43e6-8d65-4440063ce19c tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:27.137677 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0bf4e869-4b4e-43e6-8d65-4440063ce19c tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:27.138566 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0bf4e869-4b4e-43e6-8d65-4440063ce19c tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:27.139005 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0bf4e869-4b4e-43e6-8d65-4440063ce19c tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:27.275920 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-0bf4e869-4b4e-43e6-8d65-4440063ce19c tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197cb8739df848a6bc9de7a90b6da99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac6add618145708d682ab7de8fa3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:09:27.283251 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-0bf4e869-4b4e-43e6-8d65-4440063ce19c tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 200 len: 1570 microversion: 2.1 time: 0.169860 Nov 23 09:09:27.283825 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 544/1089] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:27 2021] GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 1570 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:09:27.548441 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-55764e8e-f95c-4461-aa65-e07c66dc7068 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:27.549532 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-55764e8e-f95c-4461-aa65-e07c66dc7068 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:27.556957 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-55764e8e-f95c-4461-aa65-e07c66dc7068 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:27.557541 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-55764e8e-f95c-4461-aa65-e07c66dc7068 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:27.558431 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-55764e8e-f95c-4461-aa65-e07c66dc7068 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:27.558957 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-55764e8e-f95c-4461-aa65-e07c66dc7068 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:27.629893 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-55764e8e-f95c-4461-aa65-e07c66dc7068 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action" status: 200 len: 9709 microversion: 2.1 time: 0.086288 Nov 23 09:09:27.630552 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 546/1090] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:09:27 2021] POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action => generated 9709 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:09:28.299604 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-ac4ef13e-4018-4024-a766-1a86210e466c tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:28.300317 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-ac4ef13e-4018-4024-a766-1a86210e466c tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:28.306698 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ac4ef13e-4018-4024-a766-1a86210e466c tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:28.307216 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ac4ef13e-4018-4024-a766-1a86210e466c tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:28.308057 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ac4ef13e-4018-4024-a766-1a86210e466c tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:28.308556 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ac4ef13e-4018-4024-a766-1a86210e466c tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:28.519371 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-ac4ef13e-4018-4024-a766-1a86210e466c tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197cb8739df848a6bc9de7a90b6da99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac6add618145708d682ab7de8fa3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:09:28.527275 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-ac4ef13e-4018-4024-a766-1a86210e466c tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 200 len: 1570 microversion: 2.1 time: 0.231331 Nov 23 09:09:28.528219 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 545/1091] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:28 2021] GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 1570 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:09:28.641726 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-1c84f9b4-f979-4a91-b39c-d7ebb7d75908 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:28.642865 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-1c84f9b4-f979-4a91-b39c-d7ebb7d75908 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:28.649713 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1c84f9b4-f979-4a91-b39c-d7ebb7d75908 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:28.650381 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1c84f9b4-f979-4a91-b39c-d7ebb7d75908 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:28.651361 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1c84f9b4-f979-4a91-b39c-d7ebb7d75908 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:28.651796 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1c84f9b4-f979-4a91-b39c-d7ebb7d75908 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:28.733831 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-1c84f9b4-f979-4a91-b39c-d7ebb7d75908 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action" status: 200 len: 16678 microversion: 2.1 time: 0.095906 Nov 23 09:09:28.734858 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 547/1092] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:09:28 2021] POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action => generated 16678 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:09:29.544234 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f9a7136d-5df1-4e96-a6f0-75c0245c7fa0 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:29.545084 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f9a7136d-5df1-4e96-a6f0-75c0245c7fa0 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:29.552325 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f9a7136d-5df1-4e96-a6f0-75c0245c7fa0 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:29.553050 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f9a7136d-5df1-4e96-a6f0-75c0245c7fa0 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:29.554713 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f9a7136d-5df1-4e96-a6f0-75c0245c7fa0 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:29.555612 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f9a7136d-5df1-4e96-a6f0-75c0245c7fa0 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:29.691076 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-f9a7136d-5df1-4e96-a6f0-75c0245c7fa0 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197cb8739df848a6bc9de7a90b6da99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac6add618145708d682ab7de8fa3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:09:29.698656 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f9a7136d-5df1-4e96-a6f0-75c0245c7fa0 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 200 len: 1570 microversion: 2.1 time: 0.158623 Nov 23 09:09:29.699230 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 546/1093] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:29 2021] GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:09:29.746460 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-cf7558e6-090d-4962-aa76-0e93227ffb23 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:29.747774 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-cf7558e6-090d-4962-aa76-0e93227ffb23 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:29.755274 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-cf7558e6-090d-4962-aa76-0e93227ffb23 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:29.755724 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-cf7558e6-090d-4962-aa76-0e93227ffb23 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:29.756523 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-cf7558e6-090d-4962-aa76-0e93227ffb23 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:29.756995 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-cf7558e6-090d-4962-aa76-0e93227ffb23 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:29.830190 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-cf7558e6-090d-4962-aa76-0e93227ffb23 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action" status: 200 len: 18305 microversion: 2.1 time: 0.087793 Nov 23 09:09:29.830855 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 548/1094] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:09:29 2021] POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action => generated 18305 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:09:30.716041 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-bcfc1155-678e-46e1-8653-c5fb602d8b79 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:30.716583 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-bcfc1155-678e-46e1-8653-c5fb602d8b79 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:30.722811 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bcfc1155-678e-46e1-8653-c5fb602d8b79 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:30.723267 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bcfc1155-678e-46e1-8653-c5fb602d8b79 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:30.724051 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bcfc1155-678e-46e1-8653-c5fb602d8b79 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:30.724491 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bcfc1155-678e-46e1-8653-c5fb602d8b79 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:30.842962 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-82366b92-1efe-4bd7-8c96-207e1643fcab tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:30.843997 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-82366b92-1efe-4bd7-8c96-207e1643fcab tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:30.851188 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-82366b92-1efe-4bd7-8c96-207e1643fcab tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:30.851650 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-82366b92-1efe-4bd7-8c96-207e1643fcab tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:30.853207 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-82366b92-1efe-4bd7-8c96-207e1643fcab tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:30.853670 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-82366b92-1efe-4bd7-8c96-207e1643fcab tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:30.854924 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-bcfc1155-678e-46e1-8653-c5fb602d8b79 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197cb8739df848a6bc9de7a90b6da99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac6add618145708d682ab7de8fa3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:09:30.863167 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-bcfc1155-678e-46e1-8653-c5fb602d8b79 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 200 len: 1570 microversion: 2.1 time: 0.151293 Nov 23 09:09:30.863744 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 547/1095] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:30 2021] GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:09:30.927883 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-82366b92-1efe-4bd7-8c96-207e1643fcab tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action" status: 200 len: 20915 microversion: 2.1 time: 0.088932 Nov 23 09:09:30.929038 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 549/1096] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:09:30 2021] POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action => generated 20915 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 09:09:31.881026 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-fddf9899-1948-4c0c-90c5-c402e557b66e tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:31.881787 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-fddf9899-1948-4c0c-90c5-c402e557b66e tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:31.888053 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fddf9899-1948-4c0c-90c5-c402e557b66e tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:31.888499 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fddf9899-1948-4c0c-90c5-c402e557b66e tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:31.889313 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fddf9899-1948-4c0c-90c5-c402e557b66e tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:31.889750 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fddf9899-1948-4c0c-90c5-c402e557b66e tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:31.940356 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-835fa63a-5fb9-42d2-88e9-9a543bfeb27d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:31.942113 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-835fa63a-5fb9-42d2-88e9-9a543bfeb27d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:31.950193 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-835fa63a-5fb9-42d2-88e9-9a543bfeb27d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:31.950653 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-835fa63a-5fb9-42d2-88e9-9a543bfeb27d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:31.951465 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-835fa63a-5fb9-42d2-88e9-9a543bfeb27d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:31.951899 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-835fa63a-5fb9-42d2-88e9-9a543bfeb27d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:32.022370 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-835fa63a-5fb9-42d2-88e9-9a543bfeb27d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action" status: 200 len: 22897 microversion: 2.1 time: 0.085860 Nov 23 09:09:32.023115 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 550/1097] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:09:31 2021] POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action => generated 22897 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 09:09:32.027308 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-fddf9899-1948-4c0c-90c5-c402e557b66e tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197cb8739df848a6bc9de7a90b6da99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac6add618145708d682ab7de8fa3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:09:32.035289 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-fddf9899-1948-4c0c-90c5-c402e557b66e tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 200 len: 1570 microversion: 2.1 time: 0.157913 Nov 23 09:09:32.036200 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 548/1098] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:31 2021] GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:09:33.033965 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-3305baa8-869e-44df-a276-61630ae50ebd tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:33.034955 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-3305baa8-869e-44df-a276-61630ae50ebd tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:33.041800 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3305baa8-869e-44df-a276-61630ae50ebd tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:33.042254 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3305baa8-869e-44df-a276-61630ae50ebd tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:33.043568 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3305baa8-869e-44df-a276-61630ae50ebd tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:33.044179 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3305baa8-869e-44df-a276-61630ae50ebd tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:33.052833 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-35666937-f0c5-4ab2-be8f-95ac51f56786 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:33.053490 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-35666937-f0c5-4ab2-be8f-95ac51f56786 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:33.060418 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-35666937-f0c5-4ab2-be8f-95ac51f56786 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:33.060863 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-35666937-f0c5-4ab2-be8f-95ac51f56786 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:33.061662 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-35666937-f0c5-4ab2-be8f-95ac51f56786 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:33.062102 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-35666937-f0c5-4ab2-be8f-95ac51f56786 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:33.113035 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-3305baa8-869e-44df-a276-61630ae50ebd tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action" status: 200 len: 23804 microversion: 2.1 time: 0.082927 Nov 23 09:09:33.113861 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 551/1099] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:09:33 2021] POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action => generated 23804 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:09:33.191470 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-35666937-f0c5-4ab2-be8f-95ac51f56786 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197cb8739df848a6bc9de7a90b6da99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac6add618145708d682ab7de8fa3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:09:33.198703 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-35666937-f0c5-4ab2-be8f-95ac51f56786 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 200 len: 1570 microversion: 2.1 time: 0.149516 Nov 23 09:09:33.199463 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 549/1100] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:33 2021] GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:09:34.125175 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-ad861ff0-5f8c-4f4b-8344-7c3444c9dcc9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:34.126183 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-ad861ff0-5f8c-4f4b-8344-7c3444c9dcc9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:34.134290 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ad861ff0-5f8c-4f4b-8344-7c3444c9dcc9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:34.134746 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ad861ff0-5f8c-4f4b-8344-7c3444c9dcc9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:34.136302 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ad861ff0-5f8c-4f4b-8344-7c3444c9dcc9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:34.137082 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ad861ff0-5f8c-4f4b-8344-7c3444c9dcc9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:34.216979 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-4a1420df-5cbe-4de1-a77a-d75acae2a046 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:34.217788 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-ad861ff0-5f8c-4f4b-8344-7c3444c9dcc9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action" status: 200 len: 25226 microversion: 2.1 time: 0.096085 Nov 23 09:09:34.217913 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-4a1420df-5cbe-4de1-a77a-d75acae2a046 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:34.218297 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 552/1101] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:09:34 2021] POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action => generated 25226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 09:09:34.224299 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4a1420df-5cbe-4de1-a77a-d75acae2a046 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:34.224759 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4a1420df-5cbe-4de1-a77a-d75acae2a046 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:34.225574 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4a1420df-5cbe-4de1-a77a-d75acae2a046 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:34.226198 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4a1420df-5cbe-4de1-a77a-d75acae2a046 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:34.359563 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-4a1420df-5cbe-4de1-a77a-d75acae2a046 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197cb8739df848a6bc9de7a90b6da99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac6add618145708d682ab7de8fa3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:09:34.366812 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-4a1420df-5cbe-4de1-a77a-d75acae2a046 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 200 len: 1511 microversion: 2.1 time: 0.154712 Nov 23 09:09:34.367381 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 550/1102] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:34 2021] GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:09:34.383588 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-d2c3870c-8cd1-4933-af7a-63afee713ae4 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:34.384254 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-d2c3870c-8cd1-4933-af7a-63afee713ae4 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:34.391545 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d2c3870c-8cd1-4933-af7a-63afee713ae4 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:34.391993 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d2c3870c-8cd1-4933-af7a-63afee713ae4 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:34.392764 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d2c3870c-8cd1-4933-af7a-63afee713ae4 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:34.393223 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-d2c3870c-8cd1-4933-af7a-63afee713ae4 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:34.470600 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-d2c3870c-8cd1-4933-af7a-63afee713ae4 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "POST /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1/action" status: 202 len: 0 microversion: 2.1 time: 0.091031 Nov 23 09:09:34.471224 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 553/1103] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:09:34 2021] POST /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 09:09:34.479183 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-70e3eb50-7c45-48ee-a9cd-c4e7320e63b1 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:34.479794 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-70e3eb50-7c45-48ee-a9cd-c4e7320e63b1 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:34.486071 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-70e3eb50-7c45-48ee-a9cd-c4e7320e63b1 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:34.486534 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-70e3eb50-7c45-48ee-a9cd-c4e7320e63b1 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:34.487663 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-70e3eb50-7c45-48ee-a9cd-c4e7320e63b1 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:34.488258 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-70e3eb50-7c45-48ee-a9cd-c4e7320e63b1 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:34.624300 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-70e3eb50-7c45-48ee-a9cd-c4e7320e63b1 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197cb8739df848a6bc9de7a90b6da99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac6add618145708d682ab7de8fa3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:09:34.631918 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-70e3eb50-7c45-48ee-a9cd-c4e7320e63b1 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 200 len: 1519 microversion: 2.1 time: 0.156154 Nov 23 09:09:34.632486 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 551/1104] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:34 2021] GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:09:35.229123 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-34ed60bf-ebc7-4bb1-a013-4312c7e49fa0 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:35.230047 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-34ed60bf-ebc7-4bb1-a013-4312c7e49fa0 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:35.235833 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-34ed60bf-ebc7-4bb1-a013-4312c7e49fa0 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:35.236281 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-34ed60bf-ebc7-4bb1-a013-4312c7e49fa0 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:35.237050 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-34ed60bf-ebc7-4bb1-a013-4312c7e49fa0 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:35.237518 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-34ed60bf-ebc7-4bb1-a013-4312c7e49fa0 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:35.308972 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-34ed60bf-ebc7-4bb1-a013-4312c7e49fa0 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action" status: 200 len: 26733 microversion: 2.1 time: 0.083712 Nov 23 09:09:35.309729 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 554/1105] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:09:35 2021] POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action => generated 26733 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:09:35.649778 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-9d6c49c4-2098-4824-9329-96facfd799e8 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:35.650386 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-9d6c49c4-2098-4824-9329-96facfd799e8 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:35.657076 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9d6c49c4-2098-4824-9329-96facfd799e8 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:35.657594 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9d6c49c4-2098-4824-9329-96facfd799e8 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:35.658690 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9d6c49c4-2098-4824-9329-96facfd799e8 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:35.659129 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9d6c49c4-2098-4824-9329-96facfd799e8 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:35.952047 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-9d6c49c4-2098-4824-9329-96facfd799e8 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197cb8739df848a6bc9de7a90b6da99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac6add618145708d682ab7de8fa3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:09:35.959561 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-9d6c49c4-2098-4824-9329-96facfd799e8 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 200 len: 1521 microversion: 2.1 time: 0.313658 Nov 23 09:09:35.960122 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 552/1106] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:35 2021] GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:09:36.321000 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-092a681c-7fdb-4af1-8bbd-1f0f2d23f90c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:36.322012 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-092a681c-7fdb-4af1-8bbd-1f0f2d23f90c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:36.329218 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-092a681c-7fdb-4af1-8bbd-1f0f2d23f90c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:36.329672 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-092a681c-7fdb-4af1-8bbd-1f0f2d23f90c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:36.330464 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-092a681c-7fdb-4af1-8bbd-1f0f2d23f90c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:36.330898 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-092a681c-7fdb-4af1-8bbd-1f0f2d23f90c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:36.405272 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-092a681c-7fdb-4af1-8bbd-1f0f2d23f90c tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action" status: 200 len: 27606 microversion: 2.1 time: 0.088042 Nov 23 09:09:36.405932 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 555/1107] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:09:36 2021] POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action => generated 27606 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 09:09:36.753617 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-b13efe20-64f7-48b6-8138-53b428330d3e req-46869837-6f4f-4e39-9de2-f5cef91792bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06366ba9-6cab-4a74-97b6-d256cd9bd6d1", "name": "network-vif-unplugged", "status": "completed", "tag": "4f3fac16-b08e-4467-807a-ffaf42239b72"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:36.755186 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:09:36.755186 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 09:09:36.763405 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-b13efe20-64f7-48b6-8138-53b428330d3e req-46869837-6f4f-4e39-9de2-f5cef91792bb service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:36.763756 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-b13efe20-64f7-48b6-8138-53b428330d3e req-46869837-6f4f-4e39-9de2-f5cef91792bb service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:36.774692 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-b13efe20-64f7-48b6-8138-53b428330d3e req-46869837-6f4f-4e39-9de2-f5cef91792bb service nova] Creating event network-vif-unplugged:4f3fac16-b08e-4467-807a-ffaf42239b72 for instance 06366ba9-6cab-4a74-97b6-d256cd9bd6d1 on hv-cinder-76845 Nov 23 09:09:36.780472 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-b13efe20-64f7-48b6-8138-53b428330d3e req-46869837-6f4f-4e39-9de2-f5cef91792bb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030474 Nov 23 09:09:36.781040 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 553/1108] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:09:36 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:09:36.985389 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-83c0b9d0-e3ce-44b2-b6bb-e6bae6b8aa88 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:36.986037 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-83c0b9d0-e3ce-44b2-b6bb-e6bae6b8aa88 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:36.992980 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-83c0b9d0-e3ce-44b2-b6bb-e6bae6b8aa88 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:36.993465 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-83c0b9d0-e3ce-44b2-b6bb-e6bae6b8aa88 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:36.994259 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-83c0b9d0-e3ce-44b2-b6bb-e6bae6b8aa88 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:36.994702 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-83c0b9d0-e3ce-44b2-b6bb-e6bae6b8aa88 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:37.127903 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-83c0b9d0-e3ce-44b2-b6bb-e6bae6b8aa88 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197cb8739df848a6bc9de7a90b6da99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac6add618145708d682ab7de8fa3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:09:37.135194 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-83c0b9d0-e3ce-44b2-b6bb-e6bae6b8aa88 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 200 len: 1577 microversion: 2.1 time: 0.153967 Nov 23 09:09:37.135766 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 556/1109] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:36 2021] GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:09:37.417698 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8f0217b4-27d5-4264-8173-aacc6aa51bd5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:37.419200 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-8f0217b4-27d5-4264-8173-aacc6aa51bd5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:37.425365 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8f0217b4-27d5-4264-8173-aacc6aa51bd5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:37.425683 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8f0217b4-27d5-4264-8173-aacc6aa51bd5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:37.426467 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8f0217b4-27d5-4264-8173-aacc6aa51bd5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:37.426914 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8f0217b4-27d5-4264-8173-aacc6aa51bd5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:37.502024 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-8f0217b4-27d5-4264-8173-aacc6aa51bd5 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action" status: 200 len: 28069 microversion: 2.1 time: 0.088289 Nov 23 09:09:37.502674 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 554/1110] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:09:37 2021] POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action => generated 28069 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:09:38.152121 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-b85237f4-a99d-4f7e-b0f3-2f4ac7e24d6e tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:38.152739 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-b85237f4-a99d-4f7e-b0f3-2f4ac7e24d6e tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:38.159038 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b85237f4-a99d-4f7e-b0f3-2f4ac7e24d6e tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:38.159480 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b85237f4-a99d-4f7e-b0f3-2f4ac7e24d6e tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:38.160249 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b85237f4-a99d-4f7e-b0f3-2f4ac7e24d6e tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:38.160680 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-b85237f4-a99d-4f7e-b0f3-2f4ac7e24d6e tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:38.293758 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-b85237f4-a99d-4f7e-b0f3-2f4ac7e24d6e tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197cb8739df848a6bc9de7a90b6da99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac6add618145708d682ab7de8fa3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:09:38.300915 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-b85237f4-a99d-4f7e-b0f3-2f4ac7e24d6e tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 200 len: 1577 microversion: 2.1 time: 0.152446 Nov 23 09:09:38.301519 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 557/1111] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:38 2021] GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:09:38.514183 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f6330a24-c28a-4b3c-8c7e-7347e694dd10 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:38.515172 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f6330a24-c28a-4b3c-8c7e-7347e694dd10 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:38.521936 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f6330a24-c28a-4b3c-8c7e-7347e694dd10 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:38.522395 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f6330a24-c28a-4b3c-8c7e-7347e694dd10 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:38.523167 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f6330a24-c28a-4b3c-8c7e-7347e694dd10 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:38.523607 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f6330a24-c28a-4b3c-8c7e-7347e694dd10 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:38.599359 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f6330a24-c28a-4b3c-8c7e-7347e694dd10 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action" status: 200 len: 28212 microversion: 2.1 time: 0.089288 Nov 23 09:09:38.599992 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 555/1112] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:09:38 2021] POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action => generated 28212 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:09:39.318038 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-e4e68437-4378-4c14-aea4-7d4f51680e70 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:39.318638 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-e4e68437-4378-4c14-aea4-7d4f51680e70 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:39.325516 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e4e68437-4378-4c14-aea4-7d4f51680e70 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:39.325959 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e4e68437-4378-4c14-aea4-7d4f51680e70 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:39.326729 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e4e68437-4378-4c14-aea4-7d4f51680e70 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:39.327156 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-e4e68437-4378-4c14-aea4-7d4f51680e70 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:39.455438 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-e4e68437-4378-4c14-aea4-7d4f51680e70 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197cb8739df848a6bc9de7a90b6da99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac6add618145708d682ab7de8fa3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:09:39.462572 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-e4e68437-4378-4c14-aea4-7d4f51680e70 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 200 len: 1577 microversion: 2.1 time: 0.148161 Nov 23 09:09:39.463139 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 558/1113] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:39 2021] GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 1577 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:09:39.611462 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e3213bb3-0f43-472f-a8d7-edfcc5a99c97 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:39.612438 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e3213bb3-0f43-472f-a8d7-edfcc5a99c97 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:39.619146 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e3213bb3-0f43-472f-a8d7-edfcc5a99c97 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:39.619591 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e3213bb3-0f43-472f-a8d7-edfcc5a99c97 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:39.620357 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e3213bb3-0f43-472f-a8d7-edfcc5a99c97 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:39.621300 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e3213bb3-0f43-472f-a8d7-edfcc5a99c97 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:39.691485 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e3213bb3-0f43-472f-a8d7-edfcc5a99c97 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action" status: 200 len: 28503 microversion: 2.1 time: 0.083839 Nov 23 09:09:39.692010 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 556/1114] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:09:39 2021] POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action => generated 28503 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:09:40.479300 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-a78c764a-12ff-4c7f-9f63-621b73a17d94 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:40.479901 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-a78c764a-12ff-4c7f-9f63-621b73a17d94 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:40.486187 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a78c764a-12ff-4c7f-9f63-621b73a17d94 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:40.486634 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a78c764a-12ff-4c7f-9f63-621b73a17d94 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:40.487406 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a78c764a-12ff-4c7f-9f63-621b73a17d94 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:40.487836 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a78c764a-12ff-4c7f-9f63-621b73a17d94 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:40.619481 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-a78c764a-12ff-4c7f-9f63-621b73a17d94 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197cb8739df848a6bc9de7a90b6da99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac6add618145708d682ab7de8fa3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:09:40.627675 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-a78c764a-12ff-4c7f-9f63-621b73a17d94 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 200 len: 1577 microversion: 2.1 time: 0.151670 Nov 23 09:09:40.628331 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 559/1115] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:40 2021] GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:09:40.703608 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f90508f8-35a9-4e7c-ba5a-7d62db3648de tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:40.704532 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f90508f8-35a9-4e7c-ba5a-7d62db3648de tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:40.711554 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f90508f8-35a9-4e7c-ba5a-7d62db3648de tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:40.712008 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f90508f8-35a9-4e7c-ba5a-7d62db3648de tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:40.712784 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f90508f8-35a9-4e7c-ba5a-7d62db3648de tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:40.713249 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f90508f8-35a9-4e7c-ba5a-7d62db3648de tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:40.785296 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f90508f8-35a9-4e7c-ba5a-7d62db3648de tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action" status: 200 len: 28671 microversion: 2.1 time: 0.085976 Nov 23 09:09:40.785936 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 557/1116] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:09:40 2021] POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action => generated 28671 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:09:41.643886 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-a19894e9-02fb-4b3c-9dd8-e5ffe9f0310f tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:41.644472 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-a19894e9-02fb-4b3c-9dd8-e5ffe9f0310f tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:41.650657 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a19894e9-02fb-4b3c-9dd8-e5ffe9f0310f tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:41.651103 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a19894e9-02fb-4b3c-9dd8-e5ffe9f0310f tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:41.651870 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a19894e9-02fb-4b3c-9dd8-e5ffe9f0310f tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:41.652534 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a19894e9-02fb-4b3c-9dd8-e5ffe9f0310f tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:41.785028 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-a19894e9-02fb-4b3c-9dd8-e5ffe9f0310f tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197cb8739df848a6bc9de7a90b6da99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac6add618145708d682ab7de8fa3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:09:41.792702 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-a19894e9-02fb-4b3c-9dd8-e5ffe9f0310f tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 200 len: 1577 microversion: 2.1 time: 0.152327 Nov 23 09:09:41.793622 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 560/1117] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:41 2021] GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:09:41.796389 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-01143b2a-0578-4b79-8a52-0826b0b9bf04 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:41.797646 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-01143b2a-0578-4b79-8a52-0826b0b9bf04 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:41.804321 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-01143b2a-0578-4b79-8a52-0826b0b9bf04 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:41.804773 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-01143b2a-0578-4b79-8a52-0826b0b9bf04 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:41.805596 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-01143b2a-0578-4b79-8a52-0826b0b9bf04 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:41.806032 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-01143b2a-0578-4b79-8a52-0826b0b9bf04 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:41.868575 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-01143b2a-0578-4b79-8a52-0826b0b9bf04 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action" status: 200 len: 28671 microversion: 2.1 time: 0.076224 Nov 23 09:09:41.869211 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 558/1118] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:09:41 2021] POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action => generated 28671 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 09:09:42.809933 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-db79ea18-a0c6-40cb-981d-cd25a0346729 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:42.810537 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-db79ea18-a0c6-40cb-981d-cd25a0346729 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:42.816683 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-db79ea18-a0c6-40cb-981d-cd25a0346729 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:42.817128 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-db79ea18-a0c6-40cb-981d-cd25a0346729 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:42.817925 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-db79ea18-a0c6-40cb-981d-cd25a0346729 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:42.818356 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-db79ea18-a0c6-40cb-981d-cd25a0346729 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:42.880862 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-65f0567b-4705-44a3-bc51-8d63c9f6de2f tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:42.881887 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-65f0567b-4705-44a3-bc51-8d63c9f6de2f tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:42.889298 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-65f0567b-4705-44a3-bc51-8d63c9f6de2f tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:42.889753 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-65f0567b-4705-44a3-bc51-8d63c9f6de2f tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:42.890540 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-65f0567b-4705-44a3-bc51-8d63c9f6de2f tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:42.890976 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-65f0567b-4705-44a3-bc51-8d63c9f6de2f tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:42.952436 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-db79ea18-a0c6-40cb-981d-cd25a0346729 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197cb8739df848a6bc9de7a90b6da99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac6add618145708d682ab7de8fa3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:09:42.958077 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-65f0567b-4705-44a3-bc51-8d63c9f6de2f tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action" status: 200 len: 28671 microversion: 2.1 time: 0.081050 Nov 23 09:09:42.958729 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 559/1119] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:09:42 2021] POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action => generated 28671 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 09:09:42.961698 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-db79ea18-a0c6-40cb-981d-cd25a0346729 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 200 len: 1577 microversion: 2.1 time: 0.155673 Nov 23 09:09:42.962258 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 561/1120] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:42 2021] GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:09:43.970554 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-2bad1557-6724-47fe-8461-021096c5ad85 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:43.971536 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-2bad1557-6724-47fe-8461-021096c5ad85 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:43.978382 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2bad1557-6724-47fe-8461-021096c5ad85 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:43.978837 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2bad1557-6724-47fe-8461-021096c5ad85 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:43.979019 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-20d747ae-ed0a-4579-86fe-7e731123833d tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:43.979615 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2bad1557-6724-47fe-8461-021096c5ad85 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:43.979739 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-20d747ae-ed0a-4579-86fe-7e731123833d tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:43.980743 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2bad1557-6724-47fe-8461-021096c5ad85 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:43.986668 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-20d747ae-ed0a-4579-86fe-7e731123833d tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:43.987123 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-20d747ae-ed0a-4579-86fe-7e731123833d tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:43.987936 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-20d747ae-ed0a-4579-86fe-7e731123833d tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:43.988376 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-20d747ae-ed0a-4579-86fe-7e731123833d tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:44.041085 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-2bad1557-6724-47fe-8461-021096c5ad85 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action" status: 200 len: 28671 microversion: 2.1 time: 0.074336 Nov 23 09:09:44.041766 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 560/1121] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:09:43 2021] POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action => generated 28671 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:09:44.119413 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-20d747ae-ed0a-4579-86fe-7e731123833d tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197cb8739df848a6bc9de7a90b6da99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac6add618145708d682ab7de8fa3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:09:44.126857 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-20d747ae-ed0a-4579-86fe-7e731123833d tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 200 len: 1564 microversion: 2.1 time: 0.151530 Nov 23 09:09:44.127422 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 562/1122] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:09:43 2021] GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 1564 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:09:45.053415 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-7d8449e4-4198-46c8-8bf0-da7f0ae7e2f4 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:45.054332 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-7d8449e4-4198-46c8-8bf0-da7f0ae7e2f4 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:45.061962 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7d8449e4-4198-46c8-8bf0-da7f0ae7e2f4 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:45.062423 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7d8449e4-4198-46c8-8bf0-da7f0ae7e2f4 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:45.063202 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7d8449e4-4198-46c8-8bf0-da7f0ae7e2f4 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:45.063641 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7d8449e4-4198-46c8-8bf0-da7f0ae7e2f4 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:45.138473 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-7d8449e4-4198-46c8-8bf0-da7f0ae7e2f4 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action" status: 200 len: 29778 microversion: 2.1 time: 0.089180 Nov 23 09:09:45.142505 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 561/1123] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:09:45 2021] POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action => generated 29778 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:09:46.150058 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-ad2eb4b7-f2fd-4a6b-9ef1-f93529f1a579 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:46.151026 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-ad2eb4b7-f2fd-4a6b-9ef1-f93529f1a579 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:46.157575 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ad2eb4b7-f2fd-4a6b-9ef1-f93529f1a579 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:46.158026 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ad2eb4b7-f2fd-4a6b-9ef1-f93529f1a579 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:46.158796 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ad2eb4b7-f2fd-4a6b-9ef1-f93529f1a579 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:46.159231 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ad2eb4b7-f2fd-4a6b-9ef1-f93529f1a579 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:46.241508 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-ad2eb4b7-f2fd-4a6b-9ef1-f93529f1a579 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action" status: 200 len: 31660 microversion: 2.1 time: 0.094958 Nov 23 09:09:46.242193 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 563/1124] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:09:46 2021] POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action => generated 31660 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:09:46.958697 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-cedde434-2988-45cb-a5c9-6f844a0490d8 req-eaa535b2-69d7-4141-a442-62afdac7d8ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06366ba9-6cab-4a74-97b6-d256cd9bd6d1", "name": "network-vif-plugged", "status": "completed", "tag": "4f3fac16-b08e-4467-807a-ffaf42239b72"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:46.960222 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:09:46.960222 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 09:09:46.968782 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-cedde434-2988-45cb-a5c9-6f844a0490d8 req-eaa535b2-69d7-4141-a442-62afdac7d8ec service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:46.969260 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-cedde434-2988-45cb-a5c9-6f844a0490d8 req-eaa535b2-69d7-4141-a442-62afdac7d8ec service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:46.979537 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-cedde434-2988-45cb-a5c9-6f844a0490d8 req-eaa535b2-69d7-4141-a442-62afdac7d8ec service nova] Creating event network-vif-plugged:4f3fac16-b08e-4467-807a-ffaf42239b72 for instance 06366ba9-6cab-4a74-97b6-d256cd9bd6d1 on hv-cinder-76845 Nov 23 09:09:46.984934 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-cedde434-2988-45cb-a5c9-6f844a0490d8 req-eaa535b2-69d7-4141-a442-62afdac7d8ec service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145880 Nov 23 09:09:46.985553 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 562/1125] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:09:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:09:47.253661 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-2b014401-04a0-419d-8e43-98334d6c0ff2 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:47.254624 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-2b014401-04a0-419d-8e43-98334d6c0ff2 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:47.262147 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2b014401-04a0-419d-8e43-98334d6c0ff2 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:47.262605 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2b014401-04a0-419d-8e43-98334d6c0ff2 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:47.263406 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2b014401-04a0-419d-8e43-98334d6c0ff2 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:47.263835 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-2b014401-04a0-419d-8e43-98334d6c0ff2 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:47.334667 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-2b014401-04a0-419d-8e43-98334d6c0ff2 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action" status: 200 len: 33295 microversion: 2.1 time: 0.084984 Nov 23 09:09:47.335286 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 564/1126] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:09:47 2021] POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action => generated 33295 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:09:48.347859 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f578dc86-7c17-48ac-ab60-bfdbea455452 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:48.348767 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f578dc86-7c17-48ac-ab60-bfdbea455452 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:48.354804 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f578dc86-7c17-48ac-ab60-bfdbea455452 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:48.355258 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f578dc86-7c17-48ac-ab60-bfdbea455452 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:48.356706 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f578dc86-7c17-48ac-ab60-bfdbea455452 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:48.357153 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f578dc86-7c17-48ac-ab60-bfdbea455452 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:48.428594 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f578dc86-7c17-48ac-ab60-bfdbea455452 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action" status: 200 len: 34268 microversion: 2.1 time: 0.085155 Nov 23 09:09:48.429247 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 563/1127] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:09:48 2021] POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action => generated 34268 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 09:09:49.441271 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-4c8ee2f1-5a9c-4f03-bb3d-d75731c5f407 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:49.442263 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-4c8ee2f1-5a9c-4f03-bb3d-d75731c5f407 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:49.449080 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4c8ee2f1-5a9c-4f03-bb3d-d75731c5f407 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:49.450070 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4c8ee2f1-5a9c-4f03-bb3d-d75731c5f407 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:49.450919 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4c8ee2f1-5a9c-4f03-bb3d-d75731c5f407 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:49.451357 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4c8ee2f1-5a9c-4f03-bb3d-d75731c5f407 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:49.521308 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-4c8ee2f1-5a9c-4f03-bb3d-d75731c5f407 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action" status: 200 len: 35345 microversion: 2.1 time: 0.084074 Nov 23 09:09:49.521917 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 565/1128] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:09:49 2021] POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action => generated 35345 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:09:50.534361 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-5c942cb1-c074-42ce-9a91-4b89fd1c1c83 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:50.535369 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-5c942cb1-c074-42ce-9a91-4b89fd1c1c83 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:50.542251 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5c942cb1-c074-42ce-9a91-4b89fd1c1c83 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:50.542710 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5c942cb1-c074-42ce-9a91-4b89fd1c1c83 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:50.544432 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5c942cb1-c074-42ce-9a91-4b89fd1c1c83 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:50.544987 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5c942cb1-c074-42ce-9a91-4b89fd1c1c83 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:50.615581 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-5c942cb1-c074-42ce-9a91-4b89fd1c1c83 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action" status: 200 len: 36813 microversion: 2.1 time: 0.085096 Nov 23 09:09:50.617001 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 564/1129] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:09:50 2021] POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action => generated 36813 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:09:51.628600 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-fb5cf796-73ea-46e9-936c-3395e52f61b8 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:51.629621 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-fb5cf796-73ea-46e9-936c-3395e52f61b8 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:51.636396 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-fb5cf796-73ea-46e9-936c-3395e52f61b8 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:51.636853 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-fb5cf796-73ea-46e9-936c-3395e52f61b8 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:51.637663 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-fb5cf796-73ea-46e9-936c-3395e52f61b8 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:51.638100 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-fb5cf796-73ea-46e9-936c-3395e52f61b8 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:51.713186 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-fb5cf796-73ea-46e9-936c-3395e52f61b8 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action" status: 200 len: 38202 microversion: 2.1 time: 0.088502 Nov 23 09:09:51.713848 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 566/1130] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:09:51 2021] POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action => generated 38202 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:09:52.725488 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-013ff8ab-eefb-4355-878f-8b5aaf0c9b69 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:52.726432 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-013ff8ab-eefb-4355-878f-8b5aaf0c9b69 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:52.733460 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-013ff8ab-eefb-4355-878f-8b5aaf0c9b69 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:52.733921 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-013ff8ab-eefb-4355-878f-8b5aaf0c9b69 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:52.734692 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-013ff8ab-eefb-4355-878f-8b5aaf0c9b69 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:52.735126 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-013ff8ab-eefb-4355-878f-8b5aaf0c9b69 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:52.796769 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-013ff8ab-eefb-4355-878f-8b5aaf0c9b69 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action" status: 200 len: 38202 microversion: 2.1 time: 0.075325 Nov 23 09:09:52.797800 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 565/1131] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:09:52 2021] POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action => generated 38202 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:09:53.809307 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-45b26926-ed2b-44bc-9730-e4a48707393a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:53.810295 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-45b26926-ed2b-44bc-9730-e4a48707393a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:53.817060 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-45b26926-ed2b-44bc-9730-e4a48707393a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:53.817541 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-45b26926-ed2b-44bc-9730-e4a48707393a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:53.818307 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-45b26926-ed2b-44bc-9730-e4a48707393a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:53.818746 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-45b26926-ed2b-44bc-9730-e4a48707393a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:53.878375 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-45b26926-ed2b-44bc-9730-e4a48707393a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action" status: 200 len: 38202 microversion: 2.1 time: 0.073204 Nov 23 09:09:53.879250 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 567/1132] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:09:53 2021] POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action => generated 38202 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:09:54.890815 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-67877528-70ea-47d1-9516-f7d23f5a1e30 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:54.891822 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-67877528-70ea-47d1-9516-f7d23f5a1e30 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:54.899125 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-67877528-70ea-47d1-9516-f7d23f5a1e30 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:54.900023 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-67877528-70ea-47d1-9516-f7d23f5a1e30 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:54.901108 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-67877528-70ea-47d1-9516-f7d23f5a1e30 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:54.901582 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-67877528-70ea-47d1-9516-f7d23f5a1e30 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:54.964302 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-67877528-70ea-47d1-9516-f7d23f5a1e30 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action" status: 200 len: 38202 microversion: 2.1 time: 0.077671 Nov 23 09:09:54.965475 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 566/1133] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:09:54 2021] POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action => generated 38202 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:09:55.977662 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-3978547c-3063-4881-a145-9b00617b3a57 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:55.978586 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-3978547c-3063-4881-a145-9b00617b3a57 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:55.987089 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3978547c-3063-4881-a145-9b00617b3a57 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:55.987552 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3978547c-3063-4881-a145-9b00617b3a57 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:55.988341 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3978547c-3063-4881-a145-9b00617b3a57 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:55.988786 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3978547c-3063-4881-a145-9b00617b3a57 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:56.058949 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-3978547c-3063-4881-a145-9b00617b3a57 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action" status: 200 len: 38331 microversion: 2.1 time: 0.085574 Nov 23 09:09:56.059621 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 568/1134] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 23 09:09:55 2021] POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/action => generated 38331 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 09:09:56.069604 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-7d7405d0-ac20-4292-9fec-0cf12dbf686e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:09:56.070217 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-7d7405d0-ac20-4292-9fec-0cf12dbf686e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:56.077003 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7d7405d0-ac20-4292-9fec-0cf12dbf686e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:56.077738 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7d7405d0-ac20-4292-9fec-0cf12dbf686e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:56.078539 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7d7405d0-ac20-4292-9fec-0cf12dbf686e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:56.078975 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7d7405d0-ac20-4292-9fec-0cf12dbf686e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:56.103258 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-7d7405d0-ac20-4292-9fec-0cf12dbf686e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/ips" status: 200 len: 146 microversion: 2.1 time: 0.037593 Nov 23 09:09:56.103851 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 567/1135] 10.222.0.46 () {58 vars in 1247 bytes} [Tue Nov 23 09:09:56 2021] GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:09:57.404223 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-1d906acd-c9fd-41a5-8459-9d20b896b031 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f85f97b-f30d-459e-aad8-3ac898a0f26e"}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:09:57.405401 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-1d906acd-c9fd-41a5-8459-9d20b896b031 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:09:57.413180 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1d906acd-c9fd-41a5-8459-9d20b896b031 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:57.413741 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1d906acd-c9fd-41a5-8459-9d20b896b031 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:57.415064 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1d906acd-c9fd-41a5-8459-9d20b896b031 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:09:57.415806 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1d906acd-c9fd-41a5-8459-9d20b896b031 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:09:57.663850 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-1d906acd-c9fd-41a5-8459-9d20b896b031 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265625 Nov 23 09:09:57.664855 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 569/1136] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 23 09:09:57 2021] POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:10:04.075222 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-2686cc39-22ba-410a-b166-9a629c390b23 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:10:04.076447 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-2686cc39-22ba-410a-b166-9a629c390b23 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:10:04.084719 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2686cc39-22ba-410a-b166-9a629c390b23 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:04.085189 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2686cc39-22ba-410a-b166-9a629c390b23 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:04.085987 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2686cc39-22ba-410a-b166-9a629c390b23 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:04.086428 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2686cc39-22ba-410a-b166-9a629c390b23 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:04.117793 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-2686cc39-22ba-410a-b166-9a629c390b23 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046898 Nov 23 09:10:04.118358 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 568/1137] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 23 09:10:04 2021] GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:10:04.128993 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-c1e43cd8-fccf-4f72-8c4c-42a64f101261 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:10:04.129706 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-c1e43cd8-fccf-4f72-8c4c-42a64f101261 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:10:04.136203 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c1e43cd8-fccf-4f72-8c4c-42a64f101261 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:04.136639 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c1e43cd8-fccf-4f72-8c4c-42a64f101261 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:04.138356 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c1e43cd8-fccf-4f72-8c4c-42a64f101261 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:04.138808 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-c1e43cd8-fccf-4f72-8c4c-42a64f101261 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:04.166632 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-c1e43cd8-fccf-4f72-8c4c-42a64f101261 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/os-volume_attachments/0f85f97b-f30d-459e-aad8-3ac898a0f26e" status: 200 len: 194 microversion: 2.1 time: 0.041713 Nov 23 09:10:04.167215 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 570/1138] 10.222.0.46 () {58 vars in 1412 bytes} [Tue Nov 23 09:10:04 2021] GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/os-volume_attachments/0f85f97b-f30d-459e-aad8-3ac898a0f26e => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:10:05.472246 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-810b057c-b816-4f73-ae97-4ae4ad5d845a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9dd58033-ca8e-4dfa-b809-50d96dd5c735"}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:10:05.473346 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-810b057c-b816-4f73-ae97-4ae4ad5d845a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:10:05.479606 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-810b057c-b816-4f73-ae97-4ae4ad5d845a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:05.480052 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-810b057c-b816-4f73-ae97-4ae4ad5d845a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:05.480981 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-810b057c-b816-4f73-ae97-4ae4ad5d845a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:05.481446 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-810b057c-b816-4f73-ae97-4ae4ad5d845a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:05.717732 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-810b057c-b816-4f73-ae97-4ae4ad5d845a tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.248958 Nov 23 09:10:05.721193 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 569/1139] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 23 09:10:05 2021] POST /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/os-volume_attachments => generated 194 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:10:13.186634 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-fd066398-1e56-49e5-a2fd-bf5b495fbfa3 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:10:13.187545 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-fd066398-1e56-49e5-a2fd-bf5b495fbfa3 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:10:13.193826 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-fd066398-1e56-49e5-a2fd-bf5b495fbfa3 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:13.194278 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-fd066398-1e56-49e5-a2fd-bf5b495fbfa3 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:13.195058 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-fd066398-1e56-49e5-a2fd-bf5b495fbfa3 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:13.195496 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-fd066398-1e56-49e5-a2fd-bf5b495fbfa3 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:13.225943 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-fd066398-1e56-49e5-a2fd-bf5b495fbfa3 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043695 Nov 23 09:10:13.226496 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 571/1140] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 23 09:10:13 2021] GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:10:13.494327 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-9e90e5b4-1392-4550-ac8c-5295e07abc9e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:10:13.494856 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-9e90e5b4-1392-4550-ac8c-5295e07abc9e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:10:13.501579 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9e90e5b4-1392-4550-ac8c-5295e07abc9e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:13.502023 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9e90e5b4-1392-4550-ac8c-5295e07abc9e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:13.502790 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9e90e5b4-1392-4550-ac8c-5295e07abc9e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:13.503220 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9e90e5b4-1392-4550-ac8c-5295e07abc9e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:13.530524 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-9e90e5b4-1392-4550-ac8c-5295e07abc9e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/os-volume_attachments/0f85f97b-f30d-459e-aad8-3ac898a0f26e" status: 200 len: 194 microversion: 2.1 time: 0.040914 Nov 23 09:10:13.531084 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 570/1141] 10.222.0.46 () {58 vars in 1412 bytes} [Tue Nov 23 09:10:13 2021] GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/os-volume_attachments/0f85f97b-f30d-459e-aad8-3ac898a0f26e => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:10:13.541012 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-50137b1e-d27b-49c8-a3d0-3965b2b19a58 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:10:13.541531 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-50137b1e-d27b-49c8-a3d0-3965b2b19a58 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:10:13.548352 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-50137b1e-d27b-49c8-a3d0-3965b2b19a58 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:13.548808 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-50137b1e-d27b-49c8-a3d0-3965b2b19a58 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:13.549620 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-50137b1e-d27b-49c8-a3d0-3965b2b19a58 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:13.550063 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-50137b1e-d27b-49c8-a3d0-3965b2b19a58 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:13.625703 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.objects.instance [None req-50137b1e-d27b-49c8-a3d0-3965b2b19a58 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lazy-loading 'services' on Instance uuid 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c {{(pid=116227) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 09:10:13.694618 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-50137b1e-d27b-49c8-a3d0-3965b2b19a58 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/os-volume_attachments/0f85f97b-f30d-459e-aad8-3ac898a0f26e" status: 202 len: 0 microversion: 2.1 time: 0.157111 Nov 23 09:10:13.695204 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 572/1142] 10.222.0.46 () {58 vars in 1415 bytes} [Tue Nov 23 09:10:13 2021] DELETE /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/os-volume_attachments/0f85f97b-f30d-459e-aad8-3ac898a0f26e => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:10:14.799122 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-18b07c95-72c6-42b5-bf45-0d09e788bd89 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:10:14.799684 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-18b07c95-72c6-42b5-bf45-0d09e788bd89 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:10:14.805790 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-18b07c95-72c6-42b5-bf45-0d09e788bd89 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:14.806242 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-18b07c95-72c6-42b5-bf45-0d09e788bd89 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:14.807015 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-18b07c95-72c6-42b5-bf45-0d09e788bd89 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:14.807452 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-18b07c95-72c6-42b5-bf45-0d09e788bd89 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:14.836034 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-18b07c95-72c6-42b5-bf45-0d09e788bd89 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/os-volume_attachments/9dd58033-ca8e-4dfa-b809-50d96dd5c735" status: 200 len: 194 microversion: 2.1 time: 0.040671 Nov 23 09:10:14.836606 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 571/1143] 10.222.0.46 () {58 vars in 1412 bytes} [Tue Nov 23 09:10:14 2021] GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/os-volume_attachments/9dd58033-ca8e-4dfa-b809-50d96dd5c735 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 09:10:14.846959 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-a2ffc18b-df93-40d5-8237-98c189eb56c2 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:10:14.847536 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-a2ffc18b-df93-40d5-8237-98c189eb56c2 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:10:14.853564 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a2ffc18b-df93-40d5-8237-98c189eb56c2 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:14.854015 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a2ffc18b-df93-40d5-8237-98c189eb56c2 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:14.854809 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a2ffc18b-df93-40d5-8237-98c189eb56c2 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:14.855230 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a2ffc18b-df93-40d5-8237-98c189eb56c2 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:14.932863 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.objects.instance [None req-a2ffc18b-df93-40d5-8237-98c189eb56c2 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lazy-loading 'services' on Instance uuid 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c {{(pid=116227) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 09:10:15.001234 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-a2ffc18b-df93-40d5-8237-98c189eb56c2 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/os-volume_attachments/9dd58033-ca8e-4dfa-b809-50d96dd5c735" status: 202 len: 0 microversion: 2.1 time: 0.158538 Nov 23 09:10:15.001830 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 573/1144] 10.222.0.46 () {58 vars in 1415 bytes} [Tue Nov 23 09:10:14 2021] DELETE /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/os-volume_attachments/9dd58033-ca8e-4dfa-b809-50d96dd5c735 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:10:16.148526 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-3e4bd830-4cb2-444b-88d9-9ab5ab9deec9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:10:16.149542 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-3e4bd830-4cb2-444b-88d9-9ab5ab9deec9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:10:16.155626 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3e4bd830-4cb2-444b-88d9-9ab5ab9deec9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:16.156081 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3e4bd830-4cb2-444b-88d9-9ab5ab9deec9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:16.156895 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3e4bd830-4cb2-444b-88d9-9ab5ab9deec9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:16.157367 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3e4bd830-4cb2-444b-88d9-9ab5ab9deec9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:16.186211 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-3e4bd830-4cb2-444b-88d9-9ab5ab9deec9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041343 Nov 23 09:10:16.186847 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 572/1145] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 23 09:10:16 2021] GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 09:10:16.285810 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-1ba48e62-d526-420c-ab92-796a7a02ceb9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:10:16.286854 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-1ba48e62-d526-420c-ab92-796a7a02ceb9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:10:16.292782 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1ba48e62-d526-420c-ab92-796a7a02ceb9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:16.293273 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1ba48e62-d526-420c-ab92-796a7a02ceb9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:16.294298 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1ba48e62-d526-420c-ab92-796a7a02ceb9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:16.294734 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-1ba48e62-d526-420c-ab92-796a7a02ceb9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:16.322719 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-1ba48e62-d526-420c-ab92-796a7a02ceb9 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041440 Nov 23 09:10:16.323273 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 574/1146] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 23 09:10:16 2021] GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 09:10:16.377495 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-1daa01e9-a062-4c2c-9821-abfa8bcaf8fa tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:10:16.377992 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-1daa01e9-a062-4c2c-9821-abfa8bcaf8fa tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:10:16.383643 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1daa01e9-a062-4c2c-9821-abfa8bcaf8fa tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:16.384096 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1daa01e9-a062-4c2c-9821-abfa8bcaf8fa tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:16.384865 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1daa01e9-a062-4c2c-9821-abfa8bcaf8fa tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:16.385339 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1daa01e9-a062-4c2c-9821-abfa8bcaf8fa tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:16.408632 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-1daa01e9-a062-4c2c-9821-abfa8bcaf8fa tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Going to try to terminate instance {{(pid=116226) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 09:10:16.479626 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-1daa01e9-a062-4c2c-9821-abfa8bcaf8fa tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c" status: 204 len: 0 microversion: 2.1 time: 0.105473 Nov 23 09:10:16.480203 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 573/1147] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 23 09:10:16 2021] DELETE /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 09:10:16.489189 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-3125723f-2743-4639-b5a9-0f85cd1cd560 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:10:16.489793 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-3125723f-2743-4639-b5a9-0f85cd1cd560 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:10:16.495611 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3125723f-2743-4639-b5a9-0f85cd1cd560 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:16.496064 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3125723f-2743-4639-b5a9-0f85cd1cd560 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:16.497458 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3125723f-2743-4639-b5a9-0f85cd1cd560 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:16.497946 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3125723f-2743-4639-b5a9-0f85cd1cd560 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:16.628892 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-3125723f-2743-4639-b5a9-0f85cd1cd560 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:10:16.636228 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-3125723f-2743-4639-b5a9-0f85cd1cd560 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c" status: 200 len: 1672 microversion: 2.1 time: 0.150681 Nov 23 09:10:16.636795 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 575/1148] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:10:16 2021] GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:10:17.653726 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d38f8e9c-380b-459d-8399-d26dd10d07b1 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:10:17.654423 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d38f8e9c-380b-459d-8399-d26dd10d07b1 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:10:17.660611 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d38f8e9c-380b-459d-8399-d26dd10d07b1 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:17.661064 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d38f8e9c-380b-459d-8399-d26dd10d07b1 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:17.661882 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d38f8e9c-380b-459d-8399-d26dd10d07b1 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:17.662316 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d38f8e9c-380b-459d-8399-d26dd10d07b1 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:17.792098 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d38f8e9c-380b-459d-8399-d26dd10d07b1 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:10:17.799634 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d38f8e9c-380b-459d-8399-d26dd10d07b1 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c" status: 200 len: 1672 microversion: 2.1 time: 0.149931 Nov 23 09:10:17.800203 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 574/1149] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:10:17 2021] GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:10:18.816880 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-80c6788f-b7f8-4129-9a28-ce48e6baaa51 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:10:18.817529 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-80c6788f-b7f8-4129-9a28-ce48e6baaa51 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:10:18.823596 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-80c6788f-b7f8-4129-9a28-ce48e6baaa51 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:18.824047 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-80c6788f-b7f8-4129-9a28-ce48e6baaa51 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:18.825340 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-80c6788f-b7f8-4129-9a28-ce48e6baaa51 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:18.825784 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-80c6788f-b7f8-4129-9a28-ce48e6baaa51 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:18.892054 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-80c6788f-b7f8-4129-9a28-ce48e6baaa51 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d848da2c21474b992041ca82e1d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35872f178d144e849752bc7a845cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:10:18.899333 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-80c6788f-b7f8-4129-9a28-ce48e6baaa51 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c" status: 200 len: 1606 microversion: 2.1 time: 0.087190 Nov 23 09:10:18.900003 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 576/1150] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:10:18 2021] GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c => generated 1606 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:10:19.182630 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-73587995-0577-4c51-8b5a-2791dda66e99 req-7284bbee-60e3-42c7-b9ad-5439ad4be8f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c", "name": "network-vif-deleted", "tag": "67286026-fc00-4ed2-868d-55778cbecc47"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:10:19.185371 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:10:19.185371 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 09:10:19.195743 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-73587995-0577-4c51-8b5a-2791dda66e99 req-7284bbee-60e3-42c7-b9ad-5439ad4be8f6 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:19.196634 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-73587995-0577-4c51-8b5a-2791dda66e99 req-7284bbee-60e3-42c7-b9ad-5439ad4be8f6 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:19.211958 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-73587995-0577-4c51-8b5a-2791dda66e99 req-7284bbee-60e3-42c7-b9ad-5439ad4be8f6 service nova] Creating event network-vif-deleted:67286026-fc00-4ed2-868d-55778cbecc47 for instance 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c on hv-cinder-76845 Nov 23 09:10:19.218631 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-73587995-0577-4c51-8b5a-2791dda66e99 req-7284bbee-60e3-42c7-b9ad-5439ad4be8f6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110474 Nov 23 09:10:19.219861 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 575/1151] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:10:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:10:19.917936 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-fb399ea2-6c64-4e25-adde-667a1685c2f1 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:10:19.918608 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-fb399ea2-6c64-4e25-adde-667a1685c2f1 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:10:19.926088 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-fb399ea2-6c64-4e25-adde-667a1685c2f1 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:19.926572 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-fb399ea2-6c64-4e25-adde-667a1685c2f1 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:19.927372 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-fb399ea2-6c64-4e25-adde-667a1685c2f1 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:19.927813 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-fb399ea2-6c64-4e25-adde-667a1685c2f1 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:19.941681 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.wsgi [None req-fb399ea2-6c64-4e25-adde-667a1685c2f1 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] HTTP exception thrown: Instance 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c could not be found. Nov 23 09:10:19.942283 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-fb399ea2-6c64-4e25-adde-667a1685c2f1 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Returning 404 to user: Instance 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c could not be found. {{(pid=116227) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 09:10:19.943108 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-fb399ea2-6c64-4e25-adde-667a1685c2f1 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c" status: 404 len: 111 microversion: 2.1 time: 0.028904 Nov 23 09:10:19.943887 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 577/1152] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:10:19 2021] GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 09:10:19.953020 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-573ea168-afa0-465b-987c-7ba3775b796e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '.version_select at 0x7f527a215a60>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:10:19.971832 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-573ea168-afa0-465b-987c-7ba3775b796e tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1173159375" status: 202 len: 0 microversion: 2.1 time: 0.023396 Nov 23 09:10:19.972415 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 576/1153] 10.222.0.46 () {58 vars in 1220 bytes} [Tue Nov 23 09:10:19 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1173159375 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:10:23.095706 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-4b8b694a-0752-45ab-869e-9eac11793b02 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:10:23.096255 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-4b8b694a-0752-45ab-869e-9eac11793b02 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:10:23.102482 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4b8b694a-0752-45ab-869e-9eac11793b02 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:23.102930 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4b8b694a-0752-45ab-869e-9eac11793b02 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:23.103704 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4b8b694a-0752-45ab-869e-9eac11793b02 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:23.104139 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4b8b694a-0752-45ab-869e-9eac11793b02 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:23.117706 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.wsgi [None req-4b8b694a-0752-45ab-869e-9eac11793b02 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] HTTP exception thrown: Instance 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c could not be found. Nov 23 09:10:23.118319 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-4b8b694a-0752-45ab-869e-9eac11793b02 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Returning 404 to user: Instance 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c could not be found. {{(pid=116227) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 09:10:23.119127 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-4b8b694a-0752-45ab-869e-9eac11793b02 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c" status: 404 len: 111 microversion: 2.1 time: 0.027093 Nov 23 09:10:23.119655 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 578/1154] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 23 09:10:23 2021] DELETE /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 09:10:23.128015 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a0c7d78b-5448-4a96-bfe3-09929514101d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:10:23.128748 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a0c7d78b-5448-4a96-bfe3-09929514101d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:10:23.134808 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a0c7d78b-5448-4a96-bfe3-09929514101d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:23.135269 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a0c7d78b-5448-4a96-bfe3-09929514101d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:23.136050 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a0c7d78b-5448-4a96-bfe3-09929514101d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:23.136494 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a0c7d78b-5448-4a96-bfe3-09929514101d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:23.150325 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-a0c7d78b-5448-4a96-bfe3-09929514101d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] HTTP exception thrown: Instance 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c could not be found. Nov 23 09:10:23.150911 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a0c7d78b-5448-4a96-bfe3-09929514101d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Returning 404 to user: Instance 4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 09:10:23.151748 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a0c7d78b-5448-4a96-bfe3-09929514101d tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c" status: 404 len: 111 microversion: 2.1 time: 0.027940 Nov 23 09:10:23.152300 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 577/1155] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:10:23 2021] GET /compute/v2.1/servers/4dd08ca4-ff7e-42e8-92c4-d8ae93bfc96c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 09:10:24.278767 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-51875d9c-9572-4753-a0e4-5ebbd1ba0e47 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:10:24.279263 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-51875d9c-9572-4753-a0e4-5ebbd1ba0e47 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:10:24.286369 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-51875d9c-9572-4753-a0e4-5ebbd1ba0e47 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:24.286820 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-51875d9c-9572-4753-a0e4-5ebbd1ba0e47 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:24.287598 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-51875d9c-9572-4753-a0e4-5ebbd1ba0e47 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:24.288042 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-51875d9c-9572-4753-a0e4-5ebbd1ba0e47 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:24.301545 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.wsgi [None req-51875d9c-9572-4753-a0e4-5ebbd1ba0e47 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] HTTP exception thrown: Instance ab769fa8-d310-4b1c-be00-7d2ded9d51a8 could not be found. Nov 23 09:10:24.302126 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-51875d9c-9572-4753-a0e4-5ebbd1ba0e47 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Returning 404 to user: Instance ab769fa8-d310-4b1c-be00-7d2ded9d51a8 could not be found. {{(pid=116227) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 09:10:24.302925 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-51875d9c-9572-4753-a0e4-5ebbd1ba0e47 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 404 len: 111 microversion: 2.1 time: 0.027911 Nov 23 09:10:24.303441 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 579/1156] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 23 09:10:24 2021] DELETE /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 09:10:24.311065 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8fc609c1-a2e6-4a01-a617-462284ccc962 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:10:24.311688 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-8fc609c1-a2e6-4a01-a617-462284ccc962 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] [instance: ab769fa8-d310-4b1c-be00-7d2ded9d51a8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:10:24.317824 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8fc609c1-a2e6-4a01-a617-462284ccc962 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:24.318275 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8fc609c1-a2e6-4a01-a617-462284ccc962 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:24.319062 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8fc609c1-a2e6-4a01-a617-462284ccc962 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:24.319488 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8fc609c1-a2e6-4a01-a617-462284ccc962 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:24.332567 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-8fc609c1-a2e6-4a01-a617-462284ccc962 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] HTTP exception thrown: Instance ab769fa8-d310-4b1c-be00-7d2ded9d51a8 could not be found. Nov 23 09:10:24.333147 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8fc609c1-a2e6-4a01-a617-462284ccc962 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] Returning 404 to user: Instance ab769fa8-d310-4b1c-be00-7d2ded9d51a8 could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 09:10:24.334079 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-8fc609c1-a2e6-4a01-a617-462284ccc962 tempest-AttachVolumeTestJSON-861119156 tempest-AttachVolumeTestJSON-861119156-project] 10.222.0.46 "GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8" status: 404 len: 111 microversion: 2.1 time: 0.026676 Nov 23 09:10:24.334605 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 578/1157] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:10:24 2021] GET /compute/v2.1/servers/ab769fa8-d310-4b1c-be00-7d2ded9d51a8 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 09:10:28.343065 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-3dc4a679-4ed8-46cc-ad3f-a3b79fcbe27e tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] Action: 'create', calling method: .version_select at 0x7f527a20c790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-207643886"}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:10:28.617020 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-3dc4a679-4ed8-46cc-ad3f-a3b79fcbe27e tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.384115 Nov 23 09:10:28.617667 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 580/1158] 10.222.0.46 () {60 vars in 1154 bytes} [Tue Nov 23 09:10:28 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 385 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 23 09:10:28.628056 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a4843cac-54b3-46bd-a316-ecb72eb28c83 tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] Calling method '.version_select at 0x7f527f35aa60>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:10:28.676864 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a4843cac-54b3-46bd-a316-ecb72eb28c83 tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/3f922785-a8dd-44d9-94f1-9fc48d50aaf3" status: 200 len: 344 microversion: 2.1 time: 0.052342 Nov 23 09:10:28.677488 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 579/1159] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 23 09:10:28 2021] GET /compute/v2.1/os-volumes/3f922785-a8dd-44d9-94f1-9fc48d50aaf3 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:10:29.689840 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-6e1d8b29-cb6f-44e1-8f13-afa10a18fed9 tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] Calling method '.version_select at 0x7f527a2144c0>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:10:29.736481 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-6e1d8b29-cb6f-44e1-8f13-afa10a18fed9 tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/3f922785-a8dd-44d9-94f1-9fc48d50aaf3" status: 200 len: 345 microversion: 2.1 time: 0.050965 Nov 23 09:10:29.737075 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 581/1160] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 23 09:10:29 2021] GET /compute/v2.1/os-volumes/3f922785-a8dd-44d9-94f1-9fc48d50aaf3 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:10:29.748097 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8382cb8a-b331-4fd6-b17b-8651a1c52233 tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] Action: 'create', calling method: .version_select at 0x7f527f366d30>, body: {"snapshot": {"volume_id": "3f922785-a8dd-44d9-94f1-9fc48d50aaf3", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1967982736"}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:10:29.888555 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-8382cb8a-b331-4fd6-b17b-8651a1c52233 tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] 10.222.0.46 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.144421 Nov 23 09:10:29.894602 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 580/1161] 10.222.0.46 () {60 vars in 1161 bytes} [Tue Nov 23 09:10:29 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 09:10:29.899555 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-bdf3c724-452d-42eb-a7bd-2fce8ef4c56b tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] Calling method '.version_select at 0x7f527a291550>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:10:29.933068 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-bdf3c724-452d-42eb-a7bd-2fce8ef4c56b tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/225d7469-9bf1-406e-b4c2-cdbfbafd22c1" status: 200 len: 287 microversion: 2.1 time: 0.036995 Nov 23 09:10:29.933674 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 582/1162] 10.222.0.46 () {58 vars in 1250 bytes} [Tue Nov 23 09:10:29 2021] GET /compute/v2.1/os-snapshots/225d7469-9bf1-406e-b4c2-cdbfbafd22c1 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:10:29.943138 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-91c86969-cebf-46d7-8d3e-addf470d0b4a tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] Calling method '.version_select at 0x7f527a19f4c0>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:10:29.972129 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-91c86969-cebf-46d7-8d3e-addf470d0b4a tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.032657 Nov 23 09:10:29.972709 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 581/1163] 10.222.0.46 () {58 vars in 1139 bytes} [Tue Nov 23 09:10:29 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:10:29.982931 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-6c2db150-61b3-43e3-9d81-e18f1afdb5ff tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] Calling method '.version_select at 0x7f527a20ca60>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:10:30.011004 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-6c2db150-61b3-43e3-9d81-e18f1afdb5ff tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/225d7469-9bf1-406e-b4c2-cdbfbafd22c1" status: 200 len: 287 microversion: 2.1 time: 0.032384 Nov 23 09:10:30.011595 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 583/1164] 10.222.0.46 () {58 vars in 1250 bytes} [Tue Nov 23 09:10:29 2021] GET /compute/v2.1/os-snapshots/225d7469-9bf1-406e-b4c2-cdbfbafd22c1 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:10:31.023178 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-97f44829-68eb-426c-8fea-0322a4c4df2b tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] Calling method '.version_select at 0x7f527a30c4c0>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:10:31.051947 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-97f44829-68eb-426c-8fea-0322a4c4df2b tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/225d7469-9bf1-406e-b4c2-cdbfbafd22c1" status: 200 len: 287 microversion: 2.1 time: 0.032880 Nov 23 09:10:31.052495 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 582/1165] 10.222.0.46 () {58 vars in 1250 bytes} [Tue Nov 23 09:10:31 2021] GET /compute/v2.1/os-snapshots/225d7469-9bf1-406e-b4c2-cdbfbafd22c1 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:10:32.065712 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-38be2cbb-572e-4f97-bcda-c3fc4986659a tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] Calling method '.version_select at 0x7f527a214a60>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:10:32.094816 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-38be2cbb-572e-4f97-bcda-c3fc4986659a tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/225d7469-9bf1-406e-b4c2-cdbfbafd22c1" status: 200 len: 287 microversion: 2.1 time: 0.033958 Nov 23 09:10:32.095387 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 584/1166] 10.222.0.46 () {58 vars in 1250 bytes} [Tue Nov 23 09:10:32 2021] GET /compute/v2.1/os-snapshots/225d7469-9bf1-406e-b4c2-cdbfbafd22c1 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:10:33.105912 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-7b15027a-2508-4def-be84-524a9aab966d tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] Calling method '.version_select at 0x7f527f336f70>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:10:33.136091 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-7b15027a-2508-4def-be84-524a9aab966d tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/225d7469-9bf1-406e-b4c2-cdbfbafd22c1" status: 200 len: 288 microversion: 2.1 time: 0.034218 Nov 23 09:10:33.136766 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 583/1167] 10.222.0.46 () {58 vars in 1250 bytes} [Tue Nov 23 09:10:33 2021] GET /compute/v2.1/os-snapshots/225d7469-9bf1-406e-b4c2-cdbfbafd22c1 => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:10:33.147040 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-c89ee06b-894d-4f3a-ba06-f76dffadf8aa tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] Calling method '.version_select at 0x7f527a20c940>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:10:33.200999 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-c89ee06b-894d-4f3a-ba06-f76dffadf8aa tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] 10.222.0.46 "DELETE /compute/v2.1/os-snapshots/225d7469-9bf1-406e-b4c2-cdbfbafd22c1" status: 202 len: 0 microversion: 2.1 time: 0.057896 Nov 23 09:10:33.205206 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 585/1168] 10.222.0.46 () {58 vars in 1253 bytes} [Tue Nov 23 09:10:33 2021] DELETE /compute/v2.1/os-snapshots/225d7469-9bf1-406e-b4c2-cdbfbafd22c1 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:10:33.210844 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-996bb213-8706-4300-a8b0-5a406b52e476 tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] Calling method '.version_select at 0x7f527f3368b0>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:10:33.240654 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-996bb213-8706-4300-a8b0-5a406b52e476 tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/225d7469-9bf1-406e-b4c2-cdbfbafd22c1" status: 200 len: 287 microversion: 2.1 time: 0.033813 Nov 23 09:10:33.241242 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 584/1169] 10.222.0.46 () {58 vars in 1250 bytes} [Tue Nov 23 09:10:33 2021] GET /compute/v2.1/os-snapshots/225d7469-9bf1-406e-b4c2-cdbfbafd22c1 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:10:34.253184 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-a2426774-3aa9-4284-9cc8-1c43fcb3ae41 tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] Calling method '.version_select at 0x7f527ab06b80>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:10:34.276724 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.wsgi [None req-a2426774-3aa9-4284-9cc8-1c43fcb3ae41 tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] HTTP exception thrown: Snapshot 225d7469-9bf1-406e-b4c2-cdbfbafd22c1 could not be found. Nov 23 09:10:34.277356 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-a2426774-3aa9-4284-9cc8-1c43fcb3ae41 tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] Returning 404 to user: Snapshot 225d7469-9bf1-406e-b4c2-cdbfbafd22c1 could not be found. {{(pid=116227) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 09:10:34.278196 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-a2426774-3aa9-4284-9cc8-1c43fcb3ae41 tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/225d7469-9bf1-406e-b4c2-cdbfbafd22c1" status: 404 len: 111 microversion: 2.1 time: 0.029894 Nov 23 09:10:34.278721 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 586/1170] 10.222.0.46 () {58 vars in 1250 bytes} [Tue Nov 23 09:10:34 2021] GET /compute/v2.1/os-snapshots/225d7469-9bf1-406e-b4c2-cdbfbafd22c1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 09:10:34.287084 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-db4b3c4b-c873-4189-adce-cc7c9a99d181 tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] Calling method '.version_select at 0x7f527f366ca0>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:10:34.344313 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-db4b3c4b-c873-4189-adce-cc7c9a99d181 tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/3f922785-a8dd-44d9-94f1-9fc48d50aaf3" status: 202 len: 0 microversion: 2.1 time: 0.061223 Nov 23 09:10:34.344882 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 585/1171] 10.222.0.46 () {58 vars in 1247 bytes} [Tue Nov 23 09:10:34 2021] DELETE /compute/v2.1/os-volumes/3f922785-a8dd-44d9-94f1-9fc48d50aaf3 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:10:34.353266 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-54870a43-8782-4053-ac57-1d9387e645db tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] Calling method '.version_select at 0x7f527a2b3670>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:10:34.398254 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-54870a43-8782-4053-ac57-1d9387e645db tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/3f922785-a8dd-44d9-94f1-9fc48d50aaf3" status: 200 len: 344 microversion: 2.1 time: 0.048507 Nov 23 09:10:34.398813 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 587/1172] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 23 09:10:34 2021] GET /compute/v2.1/os-volumes/3f922785-a8dd-44d9-94f1-9fc48d50aaf3 => generated 344 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:10:35.411773 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-33057696-3cbf-4981-974c-f427adade8ad tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] Calling method '.version_select at 0x7f527a19fd30>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:10:35.438359 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-33057696-3cbf-4981-974c-f427adade8ad tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] HTTP exception thrown: Volume 3f922785-a8dd-44d9-94f1-9fc48d50aaf3 could not be found. Nov 23 09:10:35.438960 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-33057696-3cbf-4981-974c-f427adade8ad tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] Returning 404 to user: Volume 3f922785-a8dd-44d9-94f1-9fc48d50aaf3 could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 09:10:35.439791 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-33057696-3cbf-4981-974c-f427adade8ad tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/3f922785-a8dd-44d9-94f1-9fc48d50aaf3" status: 404 len: 109 microversion: 2.1 time: 0.032206 Nov 23 09:10:35.440352 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 586/1173] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 23 09:10:35 2021] GET /compute/v2.1/os-volumes/3f922785-a8dd-44d9-94f1-9fc48d50aaf3 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 09:10:35.454933 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-73b06eb7-351a-47a5-bbca-672d12e88c7e tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] Calling method '.version_select at 0x7f527a214550>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:10:35.480998 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.wsgi [None req-73b06eb7-351a-47a5-bbca-672d12e88c7e tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] HTTP exception thrown: Volume 3f922785-a8dd-44d9-94f1-9fc48d50aaf3 could not be found. Nov 23 09:10:35.481697 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-73b06eb7-351a-47a5-bbca-672d12e88c7e tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] Returning 404 to user: Volume 3f922785-a8dd-44d9-94f1-9fc48d50aaf3 could not be found. {{(pid=116227) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 09:10:35.482529 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-73b06eb7-351a-47a5-bbca-672d12e88c7e tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/3f922785-a8dd-44d9-94f1-9fc48d50aaf3" status: 404 len: 109 microversion: 2.1 time: 0.032745 Nov 23 09:10:35.483062 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 588/1174] 10.222.0.46 () {58 vars in 1247 bytes} [Tue Nov 23 09:10:35 2021] DELETE /compute/v2.1/os-volumes/3f922785-a8dd-44d9-94f1-9fc48d50aaf3 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 09:10:35.490802 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f4533cbb-01db-48d7-b9a0-cb9e42ca3fc2 tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] Calling method '.version_select at 0x7f527a303700>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:10:35.517341 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-f4533cbb-01db-48d7-b9a0-cb9e42ca3fc2 tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] HTTP exception thrown: Volume 3f922785-a8dd-44d9-94f1-9fc48d50aaf3 could not be found. Nov 23 09:10:35.517928 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f4533cbb-01db-48d7-b9a0-cb9e42ca3fc2 tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] Returning 404 to user: Volume 3f922785-a8dd-44d9-94f1-9fc48d50aaf3 could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 09:10:35.518740 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f4533cbb-01db-48d7-b9a0-cb9e42ca3fc2 tempest-VolumesSnapshotsTestJSON-902261110 tempest-VolumesSnapshotsTestJSON-902261110-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/3f922785-a8dd-44d9-94f1-9fc48d50aaf3" status: 404 len: 109 microversion: 2.1 time: 0.031801 Nov 23 09:10:35.519263 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 587/1175] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 23 09:10:35 2021] GET /compute/v2.1/os-volumes/3f922785-a8dd-44d9-94f1-9fc48d50aaf3 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 09:10:55.254454 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-3bfe3e81-7318-4010-b009-08fb66e8fb91 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1662390636", "imageRef": "18424a16-ac32-42d5-8161-d6cb36423de3", "flavorRef": "452"}} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:10:55.305083 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.network.neutron [None req-3bfe3e81-7318-4010-b009-08fb66e8fb91 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] validate_networks() for None {{(pid=116227) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 09:10:55.567672 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.virt.hardware [None req-3bfe3e81-7318-4010-b009-08fb66e8fb91 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Flavor limits 0:0:0 {{(pid=116227) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 09:10:55.568097 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.virt.hardware [None req-3bfe3e81-7318-4010-b009-08fb66e8fb91 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Image limits 0:0:0 {{(pid=116227) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 09:10:55.568572 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.virt.hardware [None req-3bfe3e81-7318-4010-b009-08fb66e8fb91 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Flavor pref 0:0:0 {{(pid=116227) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 09:10:55.568983 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.virt.hardware [None req-3bfe3e81-7318-4010-b009-08fb66e8fb91 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Image pref 0:0:0 {{(pid=116227) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 09:10:55.569420 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.virt.hardware [None req-3bfe3e81-7318-4010-b009-08fb66e8fb91 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116227) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 09:10:55.578096 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3bfe3e81-7318-4010-b009-08fb66e8fb91 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:55.578543 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3bfe3e81-7318-4010-b009-08fb66e8fb91 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:55.579356 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3bfe3e81-7318-4010-b009-08fb66e8fb91 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:55.579829 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3bfe3e81-7318-4010-b009-08fb66e8fb91 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:55.596901 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.quota [None req-3bfe3e81-7318-4010-b009-08fb66e8fb91 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Getting quotas for project 94c3fa7617a0426b87751669beef6f0c. Resources: {'instances', 'ram', 'cores'} {{(pid=116227) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 09:10:55.600759 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.quota [None req-3bfe3e81-7318-4010-b009-08fb66e8fb91 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Getting quotas for user 6f259737be224bc28fe6ba003787d72a and project 94c3fa7617a0426b87751669beef6f0c. Resources: {'instances', 'ram', 'cores'} {{(pid=116227) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 09:10:55.611807 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-3bfe3e81-7318-4010-b009-08fb66e8fb91 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Going to run 1 instances... {{(pid=116227) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 09:10:55.614100 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-3bfe3e81-7318-4010-b009-08fb66e8fb91 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] [instance: 010297b8-08e0-4b26-b671-db5dfeb6f0c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='18424a16-ac32-42d5-8161-d6cb36423de3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116227) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 09:10:55.655778 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-3bfe3e81-7318-4010-b009-08fb66e8fb91 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.407752 Nov 23 09:10:55.656414 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 589/1176] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 23 09:10:55 2021] POST /compute/v2.1/servers => generated 380 bytes in 409 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 09:10:55.667677 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-5eab3285-920c-4a78-ac69-efeea36389db tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:10:55.668281 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-5eab3285-920c-4a78-ac69-efeea36389db tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] [instance: 010297b8-08e0-4b26-b671-db5dfeb6f0c4] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:10:55.719221 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-5eab3285-920c-4a78-ac69-efeea36389db tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f259737be224bc28fe6ba003787d72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c3fa7617a0426b87751669beef6f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:10:55.726587 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-5eab3285-920c-4a78-ac69-efeea36389db tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] 10.222.0.46 "GET /compute/v2.1/servers/010297b8-08e0-4b26-b671-db5dfeb6f0c4" status: 200 len: 1215 microversion: 2.1 time: 0.063006 Nov 23 09:10:55.727158 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 588/1177] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:10:55 2021] GET /compute/v2.1/servers/010297b8-08e0-4b26-b671-db5dfeb6f0c4 => generated 1215 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:10:56.744870 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-6327c29b-ed5b-41e9-8156-5dc6e39e271c tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:10:56.745650 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-6327c29b-ed5b-41e9-8156-5dc6e39e271c tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] [instance: 010297b8-08e0-4b26-b671-db5dfeb6f0c4] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:10:56.753020 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6327c29b-ed5b-41e9-8156-5dc6e39e271c tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:56.753498 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6327c29b-ed5b-41e9-8156-5dc6e39e271c tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:56.754278 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6327c29b-ed5b-41e9-8156-5dc6e39e271c tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:56.754711 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-6327c29b-ed5b-41e9-8156-5dc6e39e271c tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:56.819171 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-6327c29b-ed5b-41e9-8156-5dc6e39e271c tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f259737be224bc28fe6ba003787d72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c3fa7617a0426b87751669beef6f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:10:56.826364 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-6327c29b-ed5b-41e9-8156-5dc6e39e271c tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] 10.222.0.46 "GET /compute/v2.1/servers/010297b8-08e0-4b26-b671-db5dfeb6f0c4" status: 200 len: 1273 microversion: 2.1 time: 0.087171 Nov 23 09:10:56.826939 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 590/1178] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:10:56 2021] GET /compute/v2.1/servers/010297b8-08e0-4b26-b671-db5dfeb6f0c4 => generated 1273 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:10:57.843480 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-3f3d2944-14b0-4e0a-b5a9-b4e53222e08b tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:10:57.844101 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-3f3d2944-14b0-4e0a-b5a9-b4e53222e08b tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] [instance: 010297b8-08e0-4b26-b671-db5dfeb6f0c4] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:10:57.850578 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3f3d2944-14b0-4e0a-b5a9-b4e53222e08b tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:57.851040 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3f3d2944-14b0-4e0a-b5a9-b4e53222e08b tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:57.851926 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3f3d2944-14b0-4e0a-b5a9-b4e53222e08b tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:57.852379 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3f3d2944-14b0-4e0a-b5a9-b4e53222e08b tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:57.962145 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-6f421be2-2837-4e49-9ef0-4d47ff113300 req-ee1bad2b-7472-4f62-aac8-4aafa7ab4940 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "010297b8-08e0-4b26-b671-db5dfeb6f0c4", "tag": "b6eca348-1336-4df5-9304-30c20b5d3d9e"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:10:57.963894 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:10:57.963894 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 09:10:57.981923 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-6f421be2-2837-4e49-9ef0-4d47ff113300 req-ee1bad2b-7472-4f62-aac8-4aafa7ab4940 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:57.983007 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-6f421be2-2837-4e49-9ef0-4d47ff113300 req-ee1bad2b-7472-4f62-aac8-4aafa7ab4940 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:57.999989 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-6f421be2-2837-4e49-9ef0-4d47ff113300 req-ee1bad2b-7472-4f62-aac8-4aafa7ab4940 service nova] Creating event network-changed:b6eca348-1336-4df5-9304-30c20b5d3d9e for instance 010297b8-08e0-4b26-b671-db5dfeb6f0c4 on hv-cinder-76845 Nov 23 09:10:58.006445 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-6f421be2-2837-4e49-9ef0-4d47ff113300 req-ee1bad2b-7472-4f62-aac8-4aafa7ab4940 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048597 Nov 23 09:10:58.007552 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 591/1179] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:10:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:10:58.017372 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-3f3d2944-14b0-4e0a-b5a9-b4e53222e08b tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f259737be224bc28fe6ba003787d72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c3fa7617a0426b87751669beef6f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:10:58.025787 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-3f3d2944-14b0-4e0a-b5a9-b4e53222e08b tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] 10.222.0.46 "GET /compute/v2.1/servers/010297b8-08e0-4b26-b671-db5dfeb6f0c4" status: 200 len: 1315 microversion: 2.1 time: 0.186084 Nov 23 09:10:58.036549 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 589/1180] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:10:57 2021] GET /compute/v2.1/servers/010297b8-08e0-4b26-b671-db5dfeb6f0c4 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:10:59.044065 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-a5097bb6-2774-4271-9937-bae45f654b84 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:10:59.044856 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-a5097bb6-2774-4271-9937-bae45f654b84 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] [instance: 010297b8-08e0-4b26-b671-db5dfeb6f0c4] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:10:59.051950 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a5097bb6-2774-4271-9937-bae45f654b84 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:59.052401 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a5097bb6-2774-4271-9937-bae45f654b84 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:59.053202 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a5097bb6-2774-4271-9937-bae45f654b84 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:10:59.053641 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-a5097bb6-2774-4271-9937-bae45f654b84 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:10:59.235752 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-a5097bb6-2774-4271-9937-bae45f654b84 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f259737be224bc28fe6ba003787d72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c3fa7617a0426b87751669beef6f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:10:59.243533 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-a5097bb6-2774-4271-9937-bae45f654b84 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] 10.222.0.46 "GET /compute/v2.1/servers/010297b8-08e0-4b26-b671-db5dfeb6f0c4" status: 200 len: 1315 microversion: 2.1 time: 0.203450 Nov 23 09:10:59.244112 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 592/1181] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:10:59 2021] GET /compute/v2.1/servers/010297b8-08e0-4b26-b671-db5dfeb6f0c4 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:11:00.259866 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-2f9e5b61-de41-43af-b6d0-d5c4f81e4af4 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:11:00.260469 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-2f9e5b61-de41-43af-b6d0-d5c4f81e4af4 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] [instance: 010297b8-08e0-4b26-b671-db5dfeb6f0c4] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:11:00.266708 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2f9e5b61-de41-43af-b6d0-d5c4f81e4af4 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:11:00.267158 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2f9e5b61-de41-43af-b6d0-d5c4f81e4af4 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:11:00.268574 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2f9e5b61-de41-43af-b6d0-d5c4f81e4af4 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:11:00.269010 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2f9e5b61-de41-43af-b6d0-d5c4f81e4af4 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:11:00.395318 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-2f9e5b61-de41-43af-b6d0-d5c4f81e4af4 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f259737be224bc28fe6ba003787d72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c3fa7617a0426b87751669beef6f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:11:00.402477 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-2f9e5b61-de41-43af-b6d0-d5c4f81e4af4 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] 10.222.0.46 "GET /compute/v2.1/servers/010297b8-08e0-4b26-b671-db5dfeb6f0c4" status: 200 len: 1315 microversion: 2.1 time: 0.146266 Nov 23 09:11:00.403029 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 590/1182] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:11:00 2021] GET /compute/v2.1/servers/010297b8-08e0-4b26-b671-db5dfeb6f0c4 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:11:01.418903 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-3cb57d53-5ef2-490a-91ba-6312a73aa23c tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:11:01.419542 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-3cb57d53-5ef2-490a-91ba-6312a73aa23c tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] [instance: 010297b8-08e0-4b26-b671-db5dfeb6f0c4] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:11:01.428162 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3cb57d53-5ef2-490a-91ba-6312a73aa23c tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:11:01.428611 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3cb57d53-5ef2-490a-91ba-6312a73aa23c tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:11:01.429413 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3cb57d53-5ef2-490a-91ba-6312a73aa23c tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:11:01.429854 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-3cb57d53-5ef2-490a-91ba-6312a73aa23c tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:11:01.557187 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-3cb57d53-5ef2-490a-91ba-6312a73aa23c tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f259737be224bc28fe6ba003787d72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c3fa7617a0426b87751669beef6f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:11:01.564447 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-3cb57d53-5ef2-490a-91ba-6312a73aa23c tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] 10.222.0.46 "GET /compute/v2.1/servers/010297b8-08e0-4b26-b671-db5dfeb6f0c4" status: 200 len: 1315 microversion: 2.1 time: 0.149267 Nov 23 09:11:01.565542 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 593/1183] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:11:01 2021] GET /compute/v2.1/servers/010297b8-08e0-4b26-b671-db5dfeb6f0c4 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:11:02.581949 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b03f2b96-8d2e-4e08-8c68-231541d4c13c tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:11:02.582549 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b03f2b96-8d2e-4e08-8c68-231541d4c13c tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] [instance: 010297b8-08e0-4b26-b671-db5dfeb6f0c4] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:11:02.588756 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b03f2b96-8d2e-4e08-8c68-231541d4c13c tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:11:02.589264 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b03f2b96-8d2e-4e08-8c68-231541d4c13c tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:11:02.590035 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b03f2b96-8d2e-4e08-8c68-231541d4c13c tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:11:02.590467 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b03f2b96-8d2e-4e08-8c68-231541d4c13c tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:11:02.717046 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b03f2b96-8d2e-4e08-8c68-231541d4c13c tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f259737be224bc28fe6ba003787d72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c3fa7617a0426b87751669beef6f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:11:02.724889 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b03f2b96-8d2e-4e08-8c68-231541d4c13c tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] 10.222.0.46 "GET /compute/v2.1/servers/010297b8-08e0-4b26-b671-db5dfeb6f0c4" status: 200 len: 1315 microversion: 2.1 time: 0.146815 Nov 23 09:11:02.725499 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 591/1184] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:11:02 2021] GET /compute/v2.1/servers/010297b8-08e0-4b26-b671-db5dfeb6f0c4 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:11:03.248319 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [req-d2251308-bad7-453c-8212-9d8544b1165f req-b7b8bc5e-f37d-478b-82b5-c2a5d282124e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "010297b8-08e0-4b26-b671-db5dfeb6f0c4", "name": "network-vif-plugged", "status": "completed", "tag": "b6eca348-1336-4df5-9304-30c20b5d3d9e"}]} {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:11:03.250084 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:11:03.250084 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: warnings.warn(msg) Nov 23 09:11:03.258441 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-d2251308-bad7-453c-8212-9d8544b1165f req-b7b8bc5e-f37d-478b-82b5-c2a5d282124e service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:11:03.258883 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [req-d2251308-bad7-453c-8212-9d8544b1165f req-b7b8bc5e-f37d-478b-82b5-c2a5d282124e service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:11:03.271909 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.compute.server_external_events [req-d2251308-bad7-453c-8212-9d8544b1165f req-b7b8bc5e-f37d-478b-82b5-c2a5d282124e service nova] Creating event network-vif-plugged:b6eca348-1336-4df5-9304-30c20b5d3d9e for instance 010297b8-08e0-4b26-b671-db5dfeb6f0c4 on hv-cinder-76845 Nov 23 09:11:03.277303 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [req-d2251308-bad7-453c-8212-9d8544b1165f req-b7b8bc5e-f37d-478b-82b5-c2a5d282124e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032460 Nov 23 09:11:03.277914 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 594/1185] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:11:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:11:03.741458 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a2a2a0ba-06a5-468c-a310-d3804323c4da tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:11:03.742013 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a2a2a0ba-06a5-468c-a310-d3804323c4da tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] [instance: 010297b8-08e0-4b26-b671-db5dfeb6f0c4] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:11:03.748110 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a2a2a0ba-06a5-468c-a310-d3804323c4da tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:11:03.748571 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a2a2a0ba-06a5-468c-a310-d3804323c4da tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:11:03.749376 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a2a2a0ba-06a5-468c-a310-d3804323c4da tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:11:03.749813 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a2a2a0ba-06a5-468c-a310-d3804323c4da tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:11:03.999218 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-547a52e7-b4a5-46d6-896b-207e9ae5e2fc tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:11:03.999810 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-547a52e7-b4a5-46d6-896b-207e9ae5e2fc tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:11:04.006387 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-547a52e7-b4a5-46d6-896b-207e9ae5e2fc tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:11:04.006845 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-547a52e7-b4a5-46d6-896b-207e9ae5e2fc tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:11:04.006961 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a2a2a0ba-06a5-468c-a310-d3804323c4da tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f259737be224bc28fe6ba003787d72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c3fa7617a0426b87751669beef6f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:11:04.007638 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-547a52e7-b4a5-46d6-896b-207e9ae5e2fc tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:11:04.008074 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-547a52e7-b4a5-46d6-896b-207e9ae5e2fc tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:11:04.014455 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a2a2a0ba-06a5-468c-a310-d3804323c4da tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] 10.222.0.46 "GET /compute/v2.1/servers/010297b8-08e0-4b26-b671-db5dfeb6f0c4" status: 200 len: 1315 microversion: 2.1 time: 0.276683 Nov 23 09:11:04.015511 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 592/1186] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:11:03 2021] GET /compute/v2.1/servers/010297b8-08e0-4b26-b671-db5dfeb6f0c4 => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:11:04.047808 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-547a52e7-b4a5-46d6-896b-207e9ae5e2fc tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Going to try to terminate instance {{(pid=116227) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 09:11:04.133648 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-547a52e7-b4a5-46d6-896b-207e9ae5e2fc tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "DELETE /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 204 len: 0 microversion: 2.1 time: 0.138178 Nov 23 09:11:04.134250 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 595/1187] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 23 09:11:03 2021] DELETE /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 23 09:11:04.144626 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-14e2bfa5-48f3-4979-a0d8-3ffbe896a2d2 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:11:04.145731 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-14e2bfa5-48f3-4979-a0d8-3ffbe896a2d2 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:11:04.151912 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-14e2bfa5-48f3-4979-a0d8-3ffbe896a2d2 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:11:04.152373 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-14e2bfa5-48f3-4979-a0d8-3ffbe896a2d2 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:11:04.153185 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-14e2bfa5-48f3-4979-a0d8-3ffbe896a2d2 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:11:04.155089 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-14e2bfa5-48f3-4979-a0d8-3ffbe896a2d2 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:11:04.171913 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-27622fd9-7896-4520-a5fd-d79aa7aa8cbe req-9dfcc508-0d1d-4f2c-a977-972b301e49b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06366ba9-6cab-4a74-97b6-d256cd9bd6d1", "tag": "4f3fac16-b08e-4467-807a-ffaf42239b72"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:11:04.173831 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:11:04.173831 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 09:11:04.181298 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-27622fd9-7896-4520-a5fd-d79aa7aa8cbe req-9dfcc508-0d1d-4f2c-a977-972b301e49b2 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:11:04.181767 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-27622fd9-7896-4520-a5fd-d79aa7aa8cbe req-9dfcc508-0d1d-4f2c-a977-972b301e49b2 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:11:04.193621 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-27622fd9-7896-4520-a5fd-d79aa7aa8cbe req-9dfcc508-0d1d-4f2c-a977-972b301e49b2 service nova] Creating event network-changed:4f3fac16-b08e-4467-807a-ffaf42239b72 for instance 06366ba9-6cab-4a74-97b6-d256cd9bd6d1 on hv-cinder-76845 Nov 23 09:11:04.198874 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-27622fd9-7896-4520-a5fd-d79aa7aa8cbe req-9dfcc508-0d1d-4f2c-a977-972b301e49b2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182329 Nov 23 09:11:04.199648 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 593/1188] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:11:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:11:04.394220 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-14e2bfa5-48f3-4979-a0d8-3ffbe896a2d2 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197cb8739df848a6bc9de7a90b6da99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac6add618145708d682ab7de8fa3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:11:04.410817 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-14e2bfa5-48f3-4979-a0d8-3ffbe896a2d2 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 200 len: 1570 microversion: 2.1 time: 0.271546 Nov 23 09:11:04.411411 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 596/1189] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:11:04 2021] GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 1570 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:11:05.032574 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-1c3a1e07-5cb4-447d-9891-88fdb379d5f2 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:11:05.033307 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-1c3a1e07-5cb4-447d-9891-88fdb379d5f2 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] [instance: 010297b8-08e0-4b26-b671-db5dfeb6f0c4] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:11:05.040140 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1c3a1e07-5cb4-447d-9891-88fdb379d5f2 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:11:05.040596 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1c3a1e07-5cb4-447d-9891-88fdb379d5f2 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:11:05.041443 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1c3a1e07-5cb4-447d-9891-88fdb379d5f2 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:11:05.041873 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1c3a1e07-5cb4-447d-9891-88fdb379d5f2 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:11:05.175874 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-1c3a1e07-5cb4-447d-9891-88fdb379d5f2 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f259737be224bc28fe6ba003787d72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c3fa7617a0426b87751669beef6f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:11:05.183202 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-1c3a1e07-5cb4-447d-9891-88fdb379d5f2 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] 10.222.0.46 "GET /compute/v2.1/servers/010297b8-08e0-4b26-b671-db5dfeb6f0c4" status: 200 len: 1465 microversion: 2.1 time: 0.155132 Nov 23 09:11:05.183764 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 594/1190] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:11:05 2021] GET /compute/v2.1/servers/010297b8-08e0-4b26-b671-db5dfeb6f0c4 => generated 1465 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:11:05.219670 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-002105a9-8fb3-48ad-b389-1e1ec8edf000 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:11:05.220214 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-002105a9-8fb3-48ad-b389-1e1ec8edf000 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] [instance: 010297b8-08e0-4b26-b671-db5dfeb6f0c4] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:11:05.226628 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-002105a9-8fb3-48ad-b389-1e1ec8edf000 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:11:05.227074 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-002105a9-8fb3-48ad-b389-1e1ec8edf000 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:11:05.227840 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-002105a9-8fb3-48ad-b389-1e1ec8edf000 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:11:05.228271 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-002105a9-8fb3-48ad-b389-1e1ec8edf000 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:11:05.251493 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-002105a9-8fb3-48ad-b389-1e1ec8edf000 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] [instance: 010297b8-08e0-4b26-b671-db5dfeb6f0c4] Going to try to terminate instance {{(pid=116227) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 09:11:05.322353 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-002105a9-8fb3-48ad-b389-1e1ec8edf000 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] 10.222.0.46 "DELETE /compute/v2.1/servers/010297b8-08e0-4b26-b671-db5dfeb6f0c4" status: 204 len: 0 microversion: 2.1 time: 0.105956 Nov 23 09:11:05.322945 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 597/1191] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 23 09:11:05 2021] DELETE /compute/v2.1/servers/010297b8-08e0-4b26-b671-db5dfeb6f0c4 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 09:11:05.331851 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-5b0a0e60-deed-4468-b887-3265934375d6 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:11:05.332473 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-5b0a0e60-deed-4468-b887-3265934375d6 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] [instance: 010297b8-08e0-4b26-b671-db5dfeb6f0c4] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:11:05.340038 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5b0a0e60-deed-4468-b887-3265934375d6 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:11:05.340520 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5b0a0e60-deed-4468-b887-3265934375d6 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:11:05.341370 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5b0a0e60-deed-4468-b887-3265934375d6 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:11:05.341806 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5b0a0e60-deed-4468-b887-3265934375d6 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:11:05.428089 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-4bebd406-de26-4a3c-aa01-c1e8bcaa4858 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:11:05.428815 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-4bebd406-de26-4a3c-aa01-c1e8bcaa4858 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:11:05.434654 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4bebd406-de26-4a3c-aa01-c1e8bcaa4858 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:11:05.435106 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4bebd406-de26-4a3c-aa01-c1e8bcaa4858 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:11:05.435889 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4bebd406-de26-4a3c-aa01-c1e8bcaa4858 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:11:05.436325 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-4bebd406-de26-4a3c-aa01-c1e8bcaa4858 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:11:05.474119 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-5b0a0e60-deed-4468-b887-3265934375d6 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f259737be224bc28fe6ba003787d72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c3fa7617a0426b87751669beef6f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:11:05.481564 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-5b0a0e60-deed-4468-b887-3265934375d6 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] 10.222.0.46 "GET /compute/v2.1/servers/010297b8-08e0-4b26-b671-db5dfeb6f0c4" status: 200 len: 1471 microversion: 2.1 time: 0.154429 Nov 23 09:11:05.482132 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 595/1192] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:11:05 2021] GET /compute/v2.1/servers/010297b8-08e0-4b26-b671-db5dfeb6f0c4 => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:11:05.574194 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-4bebd406-de26-4a3c-aa01-c1e8bcaa4858 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197cb8739df848a6bc9de7a90b6da99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac6add618145708d682ab7de8fa3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:11:05.582371 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-4bebd406-de26-4a3c-aa01-c1e8bcaa4858 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 200 len: 1452 microversion: 2.1 time: 0.158290 Nov 23 09:11:05.583019 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 598/1193] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:11:05 2021] GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:11:06.228560 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-c9306585-af35-45c8-be1b-17eb72d1bc40 req-845ae53f-c298-40b5-a2cc-339f9a5b8e39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06366ba9-6cab-4a74-97b6-d256cd9bd6d1", "name": "network-vif-deleted", "tag": "4f3fac16-b08e-4467-807a-ffaf42239b72"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:11:06.230316 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:11:06.230316 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 09:11:06.239967 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-c9306585-af35-45c8-be1b-17eb72d1bc40 req-845ae53f-c298-40b5-a2cc-339f9a5b8e39 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:11:06.240420 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-c9306585-af35-45c8-be1b-17eb72d1bc40 req-845ae53f-c298-40b5-a2cc-339f9a5b8e39 service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:11:06.252511 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-c9306585-af35-45c8-be1b-17eb72d1bc40 req-845ae53f-c298-40b5-a2cc-339f9a5b8e39 service nova] Creating event network-vif-deleted:4f3fac16-b08e-4467-807a-ffaf42239b72 for instance 06366ba9-6cab-4a74-97b6-d256cd9bd6d1 on hv-cinder-76845 Nov 23 09:11:06.257362 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-c9306585-af35-45c8-be1b-17eb72d1bc40 req-845ae53f-c298-40b5-a2cc-339f9a5b8e39 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032358 Nov 23 09:11:06.257954 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 596/1194] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:11:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 09:11:06.498082 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-66ec1260-98ff-431a-bb25-e2ef7d8f98f5 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:11:06.498713 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-66ec1260-98ff-431a-bb25-e2ef7d8f98f5 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] [instance: 010297b8-08e0-4b26-b671-db5dfeb6f0c4] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:11:06.505329 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-66ec1260-98ff-431a-bb25-e2ef7d8f98f5 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:11:06.506175 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-66ec1260-98ff-431a-bb25-e2ef7d8f98f5 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:11:06.506977 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-66ec1260-98ff-431a-bb25-e2ef7d8f98f5 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:11:06.507655 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-66ec1260-98ff-431a-bb25-e2ef7d8f98f5 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:11:06.601556 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-4cd9431c-8b0d-42d1-b90a-8a40948b93a6 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:11:06.602483 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-4cd9431c-8b0d-42d1-b90a-8a40948b93a6 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:11:06.610124 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4cd9431c-8b0d-42d1-b90a-8a40948b93a6 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:11:06.610581 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4cd9431c-8b0d-42d1-b90a-8a40948b93a6 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:11:06.611380 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4cd9431c-8b0d-42d1-b90a-8a40948b93a6 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:11:06.611847 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4cd9431c-8b0d-42d1-b90a-8a40948b93a6 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:11:06.657301 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4cd9431c-8b0d-42d1-b90a-8a40948b93a6 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:11:06.658056 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4cd9431c-8b0d-42d1-b90a-8a40948b93a6 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:11:06.659362 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.objects.instance [None req-4cd9431c-8b0d-42d1-b90a-8a40948b93a6 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lazy-loading 'fault' on Instance uuid 06366ba9-6cab-4a74-97b6-d256cd9bd6d1 {{(pid=116226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 09:11:06.680271 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.policy [None req-66ec1260-98ff-431a-bb25-e2ef7d8f98f5 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f259737be224bc28fe6ba003787d72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c3fa7617a0426b87751669beef6f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116227) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:11:06.689626 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-66ec1260-98ff-431a-bb25-e2ef7d8f98f5 tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] 10.222.0.46 "GET /compute/v2.1/servers/010297b8-08e0-4b26-b671-db5dfeb6f0c4" status: 200 len: 1471 microversion: 2.1 time: 0.195089 Nov 23 09:11:06.690266 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 599/1195] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:11:06 2021] GET /compute/v2.1/servers/010297b8-08e0-4b26-b671-db5dfeb6f0c4 => generated 1471 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 09:11:06.702031 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-4cd9431c-8b0d-42d1-b90a-8a40948b93a6 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197cb8739df848a6bc9de7a90b6da99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac6add618145708d682ab7de8fa3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 09:11:06.710364 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-4cd9431c-8b0d-42d1-b90a-8a40948b93a6 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 200 len: 1225 microversion: 2.1 time: 0.114287 Nov 23 09:11:06.710940 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 597/1196] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:11:06 2021] GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 1225 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 09:11:07.706828 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-ee441f59-92e6-4ae3-9e9a-877d29cc22db tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Calling method '>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:11:07.707444 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.compute.api [None req-ee441f59-92e6-4ae3-9e9a-877d29cc22db tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] [instance: 010297b8-08e0-4b26-b671-db5dfeb6f0c4] Fetching instance by UUID {{(pid=116227) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:11:07.713905 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ee441f59-92e6-4ae3-9e9a-877d29cc22db tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:11:07.714356 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ee441f59-92e6-4ae3-9e9a-877d29cc22db tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:11:07.715136 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ee441f59-92e6-4ae3-9e9a-877d29cc22db tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:11:07.715571 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG oslo_concurrency.lockutils [None req-ee441f59-92e6-4ae3-9e9a-877d29cc22db tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:11:07.727523 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-9f09daf9-ae58-470c-9e1f-ca92340ff4aa tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:11:07.728164 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-9f09daf9-ae58-470c-9e1f-ca92340ff4aa tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] [instance: 06366ba9-6cab-4a74-97b6-d256cd9bd6d1] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 09:11:07.729637 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.wsgi [None req-ee441f59-92e6-4ae3-9e9a-877d29cc22db tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] HTTP exception thrown: Instance 010297b8-08e0-4b26-b671-db5dfeb6f0c4 could not be found. Nov 23 09:11:07.730384 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-ee441f59-92e6-4ae3-9e9a-877d29cc22db tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] Returning 404 to user: Instance 010297b8-08e0-4b26-b671-db5dfeb6f0c4 could not be found. {{(pid=116227) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 09:11:07.731206 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-ee441f59-92e6-4ae3-9e9a-877d29cc22db tempest-VolumesNegativeTest-1540579416 tempest-VolumesNegativeTest-1540579416-project] 10.222.0.46 "GET /compute/v2.1/servers/010297b8-08e0-4b26-b671-db5dfeb6f0c4" status: 404 len: 111 microversion: 2.1 time: 0.028488 Nov 23 09:11:07.731756 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 600/1197] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:11:07 2021] GET /compute/v2.1/servers/010297b8-08e0-4b26-b671-db5dfeb6f0c4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 09:11:07.734624 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9f09daf9-ae58-470c-9e1f-ca92340ff4aa tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:11:07.735076 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9f09daf9-ae58-470c-9e1f-ca92340ff4aa tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:11:07.735914 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9f09daf9-ae58-470c-9e1f-ca92340ff4aa tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:11:07.736364 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9f09daf9-ae58-470c-9e1f-ca92340ff4aa tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:11:07.750380 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-9f09daf9-ae58-470c-9e1f-ca92340ff4aa tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] HTTP exception thrown: Instance 06366ba9-6cab-4a74-97b6-d256cd9bd6d1 could not be found. Nov 23 09:11:07.750970 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-9f09daf9-ae58-470c-9e1f-ca92340ff4aa tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Returning 404 to user: Instance 06366ba9-6cab-4a74-97b6-d256cd9bd6d1 could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 09:11:07.751808 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-9f09daf9-ae58-470c-9e1f-ca92340ff4aa tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1" status: 404 len: 111 microversion: 2.1 time: 0.027936 Nov 23 09:11:07.752547 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 598/1198] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 23 09:11:07 2021] GET /compute/v2.1/servers/06366ba9-6cab-4a74-97b6-d256cd9bd6d1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 23 09:11:07.916280 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: DEBUG nova.api.openstack.wsgi [None req-3abe1626-f298-4d88-ae37-245f1877db26 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] Calling method '.version_select at 0x7f527a265ee0>' {{(pid=116227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 09:11:07.937294 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO nova.api.openstack.requestlog [None req-3abe1626-f298-4d88-ae37-245f1877db26 tempest-TestShelveInstance-1600663789 tempest-TestShelveInstance-1600663789-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1101682205" status: 202 len: 0 microversion: 2.1 time: 0.024873 Nov 23 09:11:07.937964 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: [pid: 116227|app: 0|req: 601/1199] 10.222.0.46 () {58 vars in 1253 bytes} [Tue Nov 23 09:11:07 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1101682205 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 09:11:08.273748 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-fd50f044-e353-4539-96cd-f6407a10df29 req-a5287bd9-2764-47b8-b6d7-6a73bdb2eafe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "010297b8-08e0-4b26-b671-db5dfeb6f0c4", "name": "network-vif-deleted", "tag": "b6eca348-1336-4df5-9304-30c20b5d3d9e"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 09:11:08.275454 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 09:11:08.275454 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Nov 23 09:11:08.288354 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-fd50f044-e353-4539-96cd-f6407a10df29 req-a5287bd9-2764-47b8-b6d7-6a73bdb2eafe service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 09:11:08.289523 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-fd50f044-e353-4539-96cd-f6407a10df29 req-a5287bd9-2764-47b8-b6d7-6a73bdb2eafe service nova] Lock "848a0ecb-e389-4eb0-b537-075130526b9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 09:11:08.304009 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-fd50f044-e353-4539-96cd-f6407a10df29 req-a5287bd9-2764-47b8-b6d7-6a73bdb2eafe service nova] Creating event network-vif-deleted:b6eca348-1336-4df5-9304-30c20b5d3d9e for instance 010297b8-08e0-4b26-b671-db5dfeb6f0c4 on hv-cinder-76845 Nov 23 09:11:08.309996 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-fd50f044-e353-4539-96cd-f6407a10df29 req-a5287bd9-2764-47b8-b6d7-6a73bdb2eafe service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039924 Nov 23 09:11:08.310878 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 599/1200] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 23 09:11:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 09:11:56.865638 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 09:11:56.866323 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: Tue Nov 23 09:11:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 09:13:21.931901 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 09:13:21.932543 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: Tue Nov 23 09:13:21 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 09:13:37.803138 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 09:13:37.803723 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: Tue Nov 23 09:13:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 09:13:52.822746 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 09:13:52.823404 dv-cinder-768458-17-iscsi devstack@n-api.service[116227]: Tue Nov 23 09:13:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 09:14:09.756682 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 09:14:09.757199 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: Tue Nov 23 09:14:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 09:15:16.883295 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 09:15:16.883955 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: Tue Nov 23 09:15:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 09:15:27.036423 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 09:15:27.037112 dv-cinder-768458-17-iscsi devstack@n-api.service[116226]: Tue Nov 23 09:15:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!